2023-02-17 22:00:52,944 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-17 22:00:53,000 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=171, AvailableMemoryMB=9115 2023-02-17 22:00:53,297 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69 2023-02-17 22:00:53,305 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:00:53,305 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9, deleteOnExit=true 2023-02-17 22:00:53,305 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:00:53,306 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/test.cache.data in system properties and HBase conf 2023-02-17 22:00:53,307 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:00:53,307 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:00:53,308 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:00:53,308 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:00:53,309 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:00:53,426 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-17 22:00:53,859 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:00:53,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:00:53,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:00:53,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:00:53,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:00:53,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:00:53,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:00:53,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:00:53,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:00:53,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:00:53,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:00:53,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:00:53,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:00:53,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:00:53,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:00:54,451 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:00:54,456 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:00:54,782 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-17 22:00:54,982 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-17 22:00:55,001 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:00:55,051 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:00:55,089 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/java.io.tmpdir/Jetty_localhost_42877_hdfs____59p01w/webapp 2023-02-17 22:00:55,242 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42877 2023-02-17 22:00:55,288 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:00:55,289 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:00:55,801 WARN [Listener at localhost/37673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:00:55,877 WARN [Listener at localhost/37673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:00:55,900 WARN [Listener at localhost/37673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:00:55,907 INFO [Listener at localhost/37673] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:00:55,914 INFO [Listener at localhost/37673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/java.io.tmpdir/Jetty_localhost_43463_datanode____mtch6h/webapp 2023-02-17 22:00:56,075 INFO [Listener at localhost/37673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43463 2023-02-17 22:00:56,510 WARN [Listener at localhost/41737] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:00:56,541 WARN [Listener at localhost/41737] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:00:56,547 WARN [Listener at localhost/41737] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:00:56,552 INFO [Listener at localhost/41737] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:00:56,563 INFO [Listener at localhost/41737] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/java.io.tmpdir/Jetty_localhost_35481_datanode____.ngx5am/webapp 2023-02-17 22:00:56,686 INFO [Listener at localhost/41737] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35481 2023-02-17 22:00:56,707 WARN [Listener at localhost/34531] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:00:57,083 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf33592a2f203e5ae: Processing first storage report for DS-3393fe31-300f-4e04-b339-e9d00d033b2d from datanode 101b72b6-f74c-4faa-a5c7-25920925dd47 2023-02-17 22:00:57,085 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf33592a2f203e5ae: from storage DS-3393fe31-300f-4e04-b339-e9d00d033b2d node DatanodeRegistration(127.0.0.1:45165, datanodeUuid=101b72b6-f74c-4faa-a5c7-25920925dd47, infoPort=39713, infoSecurePort=0, ipcPort=41737, storageInfo=lv=-57;cid=testClusterID;nsid=965120019;c=1676671254538), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-17 22:00:57,085 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd37a63ce2fb9c290: Processing first storage report for DS-ced01d00-c73f-451c-8005-ffaa75113bcb from datanode 645b6eb2-b38b-4262-bb6a-a2ec68e4af0c 2023-02-17 22:00:57,085 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd37a63ce2fb9c290: from storage DS-ced01d00-c73f-451c-8005-ffaa75113bcb node DatanodeRegistration(127.0.0.1:43267, datanodeUuid=645b6eb2-b38b-4262-bb6a-a2ec68e4af0c, infoPort=39035, infoSecurePort=0, ipcPort=34531, storageInfo=lv=-57;cid=testClusterID;nsid=965120019;c=1676671254538), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 22:00:57,086 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf33592a2f203e5ae: Processing first storage report for DS-3aa438b9-8f5e-4b97-9852-86853e2bc857 from datanode 101b72b6-f74c-4faa-a5c7-25920925dd47 2023-02-17 22:00:57,086 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf33592a2f203e5ae: from storage DS-3aa438b9-8f5e-4b97-9852-86853e2bc857 node DatanodeRegistration(127.0.0.1:45165, datanodeUuid=101b72b6-f74c-4faa-a5c7-25920925dd47, infoPort=39713, infoSecurePort=0, ipcPort=41737, storageInfo=lv=-57;cid=testClusterID;nsid=965120019;c=1676671254538), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:00:57,086 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd37a63ce2fb9c290: Processing first storage report for DS-58bf0cf4-4967-4d2f-ae70-2dbf88a2d18a from datanode 645b6eb2-b38b-4262-bb6a-a2ec68e4af0c 2023-02-17 22:00:57,086 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd37a63ce2fb9c290: from storage DS-58bf0cf4-4967-4d2f-ae70-2dbf88a2d18a node DatanodeRegistration(127.0.0.1:43267, datanodeUuid=645b6eb2-b38b-4262-bb6a-a2ec68e4af0c, infoPort=39035, infoSecurePort=0, ipcPort=34531, storageInfo=lv=-57;cid=testClusterID;nsid=965120019;c=1676671254538), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:00:57,191 DEBUG [Listener at localhost/34531] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69 2023-02-17 22:00:57,293 INFO [Listener at localhost/34531] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/zookeeper_0, clientPort=52138, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:00:57,312 INFO [Listener at localhost/34531] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52138 2023-02-17 22:00:57,319 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:57,321 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:57,991 INFO [Listener at localhost/34531] util.FSUtils(479): Created version file at hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5 with version=8 2023-02-17 22:00:57,991 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:57,993 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:57,997 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/hbase-staging 2023-02-17 22:00:58,369 INFO [Listener at localhost/34531] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-17 22:00:58,827 INFO [Listener at localhost/34531] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:00:58,860 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:58,861 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:58,861 INFO [Listener at localhost/34531] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:00:58,862 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:58,862 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:00:59,007 INFO [Listener at localhost/34531] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:00:59,095 DEBUG [Listener at localhost/34531] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-17 22:00:59,187 INFO [Listener at localhost/34531] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41817 2023-02-17 22:00:59,197 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,199 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,221 INFO [Listener at localhost/34531] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41817 connecting to ZooKeeper ensemble=127.0.0.1:52138 2023-02-17 22:00:59,275 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:418170x0, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:00:59,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41817-0x100644deaa80000 connected 2023-02-17 22:00:59,310 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:00:59,311 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:00:59,316 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:00:59,324 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41817 2023-02-17 22:00:59,324 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41817 2023-02-17 22:00:59,324 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41817 2023-02-17 22:00:59,326 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41817 2023-02-17 22:00:59,327 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41817 2023-02-17 22:00:59,333 INFO [Listener at localhost/34531] master.HMaster(444): hbase.rootdir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5, hbase.cluster.distributed=false 2023-02-17 22:00:59,403 INFO [Listener at localhost/34531] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:00:59,403 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:59,403 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:59,403 INFO [Listener at localhost/34531] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:00:59,403 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:59,403 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:00:59,408 INFO [Listener at localhost/34531] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:00:59,411 INFO [Listener at localhost/34531] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36361 2023-02-17 22:00:59,413 INFO [Listener at localhost/34531] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:00:59,420 DEBUG [Listener at localhost/34531] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:00:59,421 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,423 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,424 INFO [Listener at localhost/34531] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36361 connecting to ZooKeeper ensemble=127.0.0.1:52138 2023-02-17 22:00:59,428 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:363610x0, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:00:59,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36361-0x100644deaa80001 connected 2023-02-17 22:00:59,430 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:00:59,431 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:00:59,432 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:00:59,433 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36361 2023-02-17 22:00:59,435 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36361 2023-02-17 22:00:59,435 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36361 2023-02-17 22:00:59,436 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36361 2023-02-17 22:00:59,436 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36361 2023-02-17 22:00:59,449 INFO [Listener at localhost/34531] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:00:59,450 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:59,450 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:59,450 INFO [Listener at localhost/34531] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:00:59,451 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:00:59,451 INFO [Listener at localhost/34531] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:00:59,451 INFO [Listener at localhost/34531] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:00:59,453 INFO [Listener at localhost/34531] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45019 2023-02-17 22:00:59,453 INFO [Listener at localhost/34531] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:00:59,454 DEBUG [Listener at localhost/34531] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:00:59,455 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,458 INFO [Listener at localhost/34531] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,460 INFO [Listener at localhost/34531] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45019 connecting to ZooKeeper ensemble=127.0.0.1:52138 2023-02-17 22:00:59,467 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:450190x0, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:00:59,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45019-0x100644deaa80002 connected 2023-02-17 22:00:59,469 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:00:59,469 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:00:59,470 DEBUG [Listener at localhost/34531] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:00:59,475 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45019 2023-02-17 22:00:59,476 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45019 2023-02-17 22:00:59,476 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45019 2023-02-17 22:00:59,478 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45019 2023-02-17 22:00:59,478 DEBUG [Listener at localhost/34531] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45019 2023-02-17 22:00:59,483 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:00:59,492 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:00:59,494 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:00:59,513 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:00:59,513 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:00:59,513 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:00:59,513 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:00:59,514 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:00:59,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,41817,1676671258155 from backup master directory 2023-02-17 22:00:59,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:00:59,519 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:00:59,519 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:00:59,520 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:00:59,520 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:00:59,523 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-17 22:00:59,524 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-17 22:00:59,641 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/hbase.id with ID: 21c93d15-cbf4-4e02-8311-9df2845bea13 2023-02-17 22:00:59,694 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:00:59,711 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:00:59,775 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x419a4e20 to 127.0.0.1:52138 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:00:59,824 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eb32d81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:00:59,849 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:00:59,851 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:00:59,871 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-17 22:00:59,871 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-17 22:00:59,873 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-17 22:00:59,878 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-17 22:00:59,880 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:00:59,918 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store-tmp 2023-02-17 22:00:59,956 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:00:59,956 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:00:59,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:00:59,957 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:00:59,957 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:00:59,957 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:00:59,957 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:00:59,957 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:00:59,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/WALs/jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:00:59,984 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41817%2C1676671258155, suffix=, logDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/WALs/jenkins-hbase9.apache.org,41817,1676671258155, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:00,054 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK] 2023-02-17 22:01:00,054 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK] 2023-02-17 22:01:00,063 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-17 22:01:00,137 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/WALs/jenkins-hbase9.apache.org,41817,1676671258155/jenkins-hbase9.apache.org%2C41817%2C1676671258155.1676671259995 2023-02-17 22:01:00,138 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK], DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK]] 2023-02-17 22:01:00,138 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:00,139 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:00,142 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:00,143 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:00,206 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:00,213 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:00,240 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:00,254 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:00,260 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:00,262 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:00,279 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:00,284 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:00,285 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75285160, jitterRate=0.12183630466461182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:00,285 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:00,286 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:00,309 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:00,309 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:00,312 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:00,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-17 22:01:00,348 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-17 22:01:00,349 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:00,378 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:00,384 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:00,408 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:00,413 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:00,415 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:00,420 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:00,425 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:00,428 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:00,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:00,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:00,448 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:00,453 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:00,453 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:00,453 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:00,454 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:00,454 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,41817,1676671258155, sessionid=0x100644deaa80000, setting cluster-up flag (Was=false) 2023-02-17 22:01:00,470 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:00,478 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:00,479 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:01:00,486 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:00,492 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:00,494 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:01:00,497 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.hbase-snapshot/.tmp 2023-02-17 22:01:00,583 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(952): ClusterId : 21c93d15-cbf4-4e02-8311-9df2845bea13 2023-02-17 22:01:00,583 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(952): ClusterId : 21c93d15-cbf4-4e02-8311-9df2845bea13 2023-02-17 22:01:00,590 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:00,590 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:00,598 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:00,598 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:00,598 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:00,598 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:00,602 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:00,602 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:00,604 DEBUG [RS:0;jenkins-hbase9:36361] zookeeper.ReadOnlyZKClient(139): Connect 0x5f32789f to 127.0.0.1:52138 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:00,605 DEBUG [RS:1;jenkins-hbase9:45019] zookeeper.ReadOnlyZKClient(139): Connect 0x4e5f4585 to 127.0.0.1:52138 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:00,621 DEBUG [RS:1;jenkins-hbase9:45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4098b23e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:00,621 DEBUG [RS:0;jenkins-hbase9:36361] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51f59d09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:00,622 DEBUG [RS:1;jenkins-hbase9:45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a72ef5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:00,622 DEBUG [RS:0;jenkins-hbase9:36361] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55ca13ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:00,640 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:00,652 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:36361 2023-02-17 22:01:00,654 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:00,654 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:00,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:00,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:00,655 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:45019 2023-02-17 22:01:00,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:00,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,655 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:00,656 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,657 INFO [RS:1;jenkins-hbase9:45019] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:00,657 INFO [RS:0;jenkins-hbase9:36361] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:00,658 INFO [RS:1;jenkins-hbase9:45019] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:00,658 INFO [RS:0;jenkins-hbase9:36361] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:00,658 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:00,658 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:00,661 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,41817,1676671258155 with isa=jenkins-hbase9.apache.org/172.31.2.10:45019, startcode=1676671259449 2023-02-17 22:01:00,661 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,41817,1676671258155 with isa=jenkins-hbase9.apache.org/172.31.2.10:36361, startcode=1676671259402 2023-02-17 22:01:00,664 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671290664 2023-02-17 22:01:00,667 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:00,670 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:00,671 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:00,678 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:00,680 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:00,688 DEBUG [RS:0;jenkins-hbase9:36361] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:00,688 DEBUG [RS:1;jenkins-hbase9:45019] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:00,690 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:00,690 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:00,691 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:00,691 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:00,695 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,697 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:00,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:00,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:00,702 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:00,702 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:00,705 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671260704,5,FailOnTimeoutGroup] 2023-02-17 22:01:00,705 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671260705,5,FailOnTimeoutGroup] 2023-02-17 22:01:00,705 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,705 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:00,707 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,707 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,722 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:00,724 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:00,724 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5 2023-02-17 22:01:00,757 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:00,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:00,760 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44527, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:00,760 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43327, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:00,763 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/info 2023-02-17 22:01:00,764 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:00,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:00,766 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:00,771 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:00,771 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:00,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:00,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:00,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41817] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,776 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/table 2023-02-17 22:01:00,777 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:00,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:00,779 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740 2023-02-17 22:01:00,780 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740 2023-02-17 22:01:00,784 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:00,786 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:00,792 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:00,793 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69153271, jitterRate=0.030464038252830505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:00,793 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:00,794 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:00,794 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:00,794 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:00,794 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:00,794 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:00,796 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5 2023-02-17 22:01:00,796 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5 2023-02-17 22:01:00,797 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:00,797 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37673 2023-02-17 22:01:00,797 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:00,797 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37673 2023-02-17 22:01:00,797 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:00,797 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:00,802 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:00,803 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:00,807 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:00,807 DEBUG [RS:0;jenkins-hbase9:36361] zookeeper.ZKUtil(162): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,807 DEBUG [RS:1;jenkins-hbase9:45019] zookeeper.ZKUtil(162): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,807 WARN [RS:0;jenkins-hbase9:36361] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:00,808 WARN [RS:1;jenkins-hbase9:45019] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:00,808 INFO [RS:0;jenkins-hbase9:36361] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:00,808 INFO [RS:1;jenkins-hbase9:45019] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:00,809 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,809 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,809 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,36361,1676671259402] 2023-02-17 22:01:00,809 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45019,1676671259449] 2023-02-17 22:01:00,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:00,821 DEBUG [RS:1;jenkins-hbase9:45019] zookeeper.ZKUtil(162): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,821 DEBUG [RS:0;jenkins-hbase9:36361] zookeeper.ZKUtil(162): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,822 DEBUG [RS:1;jenkins-hbase9:45019] zookeeper.ZKUtil(162): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,823 DEBUG [RS:0;jenkins-hbase9:36361] zookeeper.ZKUtil(162): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,829 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:00,832 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:00,835 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:00,835 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:00,845 INFO [RS:0;jenkins-hbase9:36361] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:00,845 INFO [RS:1;jenkins-hbase9:45019] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:00,865 INFO [RS:0;jenkins-hbase9:36361] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:00,865 INFO [RS:1;jenkins-hbase9:45019] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:00,870 INFO [RS:0;jenkins-hbase9:36361] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:00,870 INFO [RS:1;jenkins-hbase9:45019] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:00,871 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,871 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,872 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:00,872 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:00,881 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,881 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,881 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,881 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,881 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:00,882 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,882 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:00,882 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,883 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,883 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,883 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,883 DEBUG [RS:0;jenkins-hbase9:36361] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,883 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,883 DEBUG [RS:1;jenkins-hbase9:45019] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:00,884 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,884 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,884 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,887 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,887 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,887 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,905 INFO [RS:0;jenkins-hbase9:36361] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:00,905 INFO [RS:1;jenkins-hbase9:45019] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:00,909 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36361,1676671259402-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,909 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45019,1676671259449-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:00,931 INFO [RS:0;jenkins-hbase9:36361] regionserver.Replication(203): jenkins-hbase9.apache.org,36361,1676671259402 started 2023-02-17 22:01:00,931 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,36361,1676671259402, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:36361, sessionid=0x100644deaa80001 2023-02-17 22:01:00,932 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:00,932 DEBUG [RS:0;jenkins-hbase9:36361] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,932 DEBUG [RS:0;jenkins-hbase9:36361] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36361,1676671259402' 2023-02-17 22:01:00,932 DEBUG [RS:0;jenkins-hbase9:36361] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:00,933 INFO [RS:1;jenkins-hbase9:45019] regionserver.Replication(203): jenkins-hbase9.apache.org,45019,1676671259449 started 2023-02-17 22:01:00,933 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,45019,1676671259449, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45019, sessionid=0x100644deaa80002 2023-02-17 22:01:00,933 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:00,933 DEBUG [RS:0;jenkins-hbase9:36361] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:00,933 DEBUG [RS:1;jenkins-hbase9:45019] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,934 DEBUG [RS:1;jenkins-hbase9:45019] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45019,1676671259449' 2023-02-17 22:01:00,935 DEBUG [RS:1;jenkins-hbase9:45019] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:00,935 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:00,935 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:00,935 DEBUG [RS:0;jenkins-hbase9:36361] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:00,935 DEBUG [RS:0;jenkins-hbase9:36361] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36361,1676671259402' 2023-02-17 22:01:00,935 DEBUG [RS:0;jenkins-hbase9:36361] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:00,936 DEBUG [RS:1;jenkins-hbase9:45019] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:00,936 DEBUG [RS:0;jenkins-hbase9:36361] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:00,936 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:00,936 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:00,937 DEBUG [RS:1;jenkins-hbase9:45019] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:00,937 DEBUG [RS:1;jenkins-hbase9:45019] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45019,1676671259449' 2023-02-17 22:01:00,937 DEBUG [RS:1;jenkins-hbase9:45019] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:00,937 DEBUG [RS:0;jenkins-hbase9:36361] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:00,938 INFO [RS:0;jenkins-hbase9:36361] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:00,938 INFO [RS:0;jenkins-hbase9:36361] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:00,938 DEBUG [RS:1;jenkins-hbase9:45019] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:00,939 DEBUG [RS:1;jenkins-hbase9:45019] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:00,939 INFO [RS:1;jenkins-hbase9:45019] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:00,939 INFO [RS:1;jenkins-hbase9:45019] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:00,984 DEBUG [jenkins-hbase9:41817] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:00,989 DEBUG [jenkins-hbase9:41817] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:00,996 DEBUG [jenkins-hbase9:41817] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:00,996 DEBUG [jenkins-hbase9:41817] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:00,996 DEBUG [jenkins-hbase9:41817] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:01,000 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,36361,1676671259402, state=OPENING 2023-02-17 22:01:01,010 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:01,012 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:01,013 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:01,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:01,206 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:01,209 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:01,213 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:01,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:01,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:01,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36361%2C1676671259402.meta, suffix=.meta, logDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,36361,1676671259402, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/oldWALs, maxLogs=32 2023-02-17 22:01:01,263 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK] 2023-02-17 22:01:01,263 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK] 2023-02-17 22:01:01,269 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,36361,1676671259402/jenkins-hbase9.apache.org%2C36361%2C1676671259402.meta.1676671261239.meta 2023-02-17 22:01:01,269 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK], DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK]] 2023-02-17 22:01:01,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:01,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:01,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:01,306 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:01,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:01,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:01,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:01,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:01,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:01,318 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/info 2023-02-17 22:01:01,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/info 2023-02-17 22:01:01,319 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:01,320 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:01,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:01,322 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:01,322 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:01,323 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:01,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:01,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:01,326 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/table 2023-02-17 22:01:01,326 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/table 2023-02-17 22:01:01,326 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:01,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:01,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740 2023-02-17 22:01:01,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740 2023-02-17 22:01:01,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:01,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:01,342 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71886188, jitterRate=0.07118767499923706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:01,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:01,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671261198 2023-02-17 22:01:01,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:01,375 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:01,375 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,36361,1676671259402, state=OPEN 2023-02-17 22:01:01,379 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:01,379 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:01,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:01,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,36361,1676671259402 in 362 msec 2023-02-17 22:01:01,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:01,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 572 msec 2023-02-17 22:01:01,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 840 msec 2023-02-17 22:01:01,398 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671261398, completionTime=-1 2023-02-17 22:01:01,398 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:01,398 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:01,466 DEBUG [hconnection-0x5a9b8d9b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:01,469 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:01,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:01,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671321487 2023-02-17 22:01:01,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671381487 2023-02-17 22:01:01,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 89 msec 2023-02-17 22:01:01,512 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41817,1676671258155-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:01,512 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41817,1676671258155-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:01,512 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41817,1676671258155-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:01,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:41817, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:01,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:01,521 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:01,529 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:01,531 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:01,548 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:01,551 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:01,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:01,580 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:01,583 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25 empty. 2023-02-17 22:01:01,584 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:01,584 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:01,619 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:01,622 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ec60fc0cd857d471a1f9cda92a612c25, NAME => 'hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:01,649 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:01,649 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ec60fc0cd857d471a1f9cda92a612c25, disabling compactions & flushes 2023-02-17 22:01:01,649 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:01,649 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:01,649 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. after waiting 0 ms 2023-02-17 22:01:01,649 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:01,649 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:01,649 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ec60fc0cd857d471a1f9cda92a612c25: 2023-02-17 22:01:01,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:01,672 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671261659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671261659"}]},"ts":"1676671261659"} 2023-02-17 22:01:01,703 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:01,705 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:01,710 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671261705"}]},"ts":"1676671261705"} 2023-02-17 22:01:01,715 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:01,719 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:01,722 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:01,722 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:01,722 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:01,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec60fc0cd857d471a1f9cda92a612c25, ASSIGN}] 2023-02-17 22:01:01,728 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec60fc0cd857d471a1f9cda92a612c25, ASSIGN 2023-02-17 22:01:01,730 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ec60fc0cd857d471a1f9cda92a612c25, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45019,1676671259449; forceNewPlan=false, retain=false 2023-02-17 22:01:01,882 INFO [jenkins-hbase9:41817] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:01,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec60fc0cd857d471a1f9cda92a612c25, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:01,884 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671261883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671261883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671261883"}]},"ts":"1676671261883"} 2023-02-17 22:01:01,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ec60fc0cd857d471a1f9cda92a612c25, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:01,949 INFO [RS:1;jenkins-hbase9:45019] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45019%2C1676671259449, suffix=, logDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,45019,1676671259449, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/oldWALs, maxLogs=32 2023-02-17 22:01:01,949 INFO [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36361%2C1676671259402, suffix=, logDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,36361,1676671259402, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/oldWALs, maxLogs=32 2023-02-17 22:01:02,000 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK] 2023-02-17 22:01:02,003 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK] 2023-02-17 22:01:02,009 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK] 2023-02-17 22:01:02,013 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK] 2023-02-17 22:01:02,014 INFO [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,36361,1676671259402/jenkins-hbase9.apache.org%2C36361%2C1676671259402.1676671261951 2023-02-17 22:01:02,014 DEBUG [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK], DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK]] 2023-02-17 22:01:02,016 INFO [RS:1;jenkins-hbase9:45019] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/WALs/jenkins-hbase9.apache.org,45019,1676671259449/jenkins-hbase9.apache.org%2C45019%2C1676671259449.1676671261952 2023-02-17 22:01:02,021 DEBUG [RS:1;jenkins-hbase9:45019] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43267,DS-ced01d00-c73f-451c-8005-ffaa75113bcb,DISK], DatanodeInfoWithStorage[127.0.0.1:45165,DS-3393fe31-300f-4e04-b339-e9d00d033b2d,DISK]] 2023-02-17 22:01:02,044 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,044 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:02,047 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52404, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:02,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:02,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec60fc0cd857d471a1f9cda92a612c25, NAME => 'hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:02,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,056 INFO [StoreOpener-ec60fc0cd857d471a1f9cda92a612c25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,059 DEBUG [StoreOpener-ec60fc0cd857d471a1f9cda92a612c25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/info 2023-02-17 22:01:02,059 DEBUG [StoreOpener-ec60fc0cd857d471a1f9cda92a612c25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/info 2023-02-17 22:01:02,059 INFO [StoreOpener-ec60fc0cd857d471a1f9cda92a612c25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec60fc0cd857d471a1f9cda92a612c25 columnFamilyName info 2023-02-17 22:01:02,060 INFO [StoreOpener-ec60fc0cd857d471a1f9cda92a612c25-1] regionserver.HStore(310): Store=ec60fc0cd857d471a1f9cda92a612c25/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:02,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,063 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:02,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:02,077 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened ec60fc0cd857d471a1f9cda92a612c25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67373383, jitterRate=0.003941640257835388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:02,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for ec60fc0cd857d471a1f9cda92a612c25: 2023-02-17 22:01:02,079 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25., pid=6, masterSystemTime=1676671262044 2023-02-17 22:01:02,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:02,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:02,087 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec60fc0cd857d471a1f9cda92a612c25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,087 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671262086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671262086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671262086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671262086"}]},"ts":"1676671262086"} 2023-02-17 22:01:02,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:02,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ec60fc0cd857d471a1f9cda92a612c25, server=jenkins-hbase9.apache.org,45019,1676671259449 in 205 msec 2023-02-17 22:01:02,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:02,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ec60fc0cd857d471a1f9cda92a612c25, ASSIGN in 374 msec 2023-02-17 22:01:02,105 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:02,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671262105"}]},"ts":"1676671262105"} 2023-02-17 22:01:02,108 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:02,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:02,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 581 msec 2023-02-17 22:01:02,151 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:02,153 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:02,153 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:02,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:02,179 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:02,193 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:02,216 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:02,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-17 22:01:02,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:02,242 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:02,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-17 22:01:02,256 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:02,260 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:02,260 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.740sec 2023-02-17 22:01:02,263 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:02,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:02,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:02,266 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41817,1676671258155-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:02,268 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41817,1676671258155-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:02,276 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:02,297 DEBUG [Listener at localhost/34531] zookeeper.ReadOnlyZKClient(139): Connect 0x5b04d0a2 to 127.0.0.1:52138 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:02,303 DEBUG [Listener at localhost/34531] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@351d31b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:02,358 DEBUG [hconnection-0x34dbfb0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:02,370 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:02,380 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:01:02,380 DEBUG [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:02,389 DEBUG [Listener at localhost/34531] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:02,392 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:02,396 INFO [Listener at localhost/34531] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 22:01:02,401 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-17 22:01:02,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:02,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.2.10:47064 deadline: 1676671322399, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 22:01:02,420 INFO [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 22:01:02,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:02,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 22:01:02,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:02,442 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:02,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 22:01:02,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:02,464 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:02,464 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:02,464 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:02,464 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:02,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 empty. 2023-02-17 22:01:02,465 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 empty. 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 empty. 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a empty. 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:02,466 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 empty. 2023-02-17 22:01:02,468 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:02,468 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:02,468 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:02,468 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 empty. 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 empty. 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb empty. 2023-02-17 22:01:02,469 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 empty. 2023-02-17 22:01:02,470 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:02,470 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:02,470 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:02,470 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:02,471 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 empty. 2023-02-17 22:01:02,472 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:02,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 22:01:02,519 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:02,537 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0937af50422382f74d368592fe0b5cd6, NAME => 'testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,556 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d701324d21e25a61c50e3e2d6bfdc5f6, NAME => 'testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,560 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1c6eb348c1685ba893d7e098594b6a96, NAME => 'testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:02,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d701324d21e25a61c50e3e2d6bfdc5f6, disabling compactions & flushes 2023-02-17 22:01:02,618 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:02,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:02,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. after waiting 0 ms 2023-02-17 22:01:02,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:02,619 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:02,619 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:02,620 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4601b8c33a946bf746ac1245a8a112f0, NAME => 'testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,621 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,621 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0937af50422382f74d368592fe0b5cd6, disabling compactions & flushes 2023-02-17 22:01:02,621 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:02,622 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:02,622 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. after waiting 0 ms 2023-02-17 22:01:02,622 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:02,622 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:02,622 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:02,623 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 147da3b7bc4c9f656b0d17dbe4da4f7a, NAME => 'testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,623 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,624 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1c6eb348c1685ba893d7e098594b6a96, disabling compactions & flushes 2023-02-17 22:01:02,624 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:02,624 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:02,624 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. after waiting 0 ms 2023-02-17 22:01:02,624 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:02,624 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:02,624 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:02,626 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1d2f1305f30ba046ad3393e66fd54326, NAME => 'testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,653 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,654 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4601b8c33a946bf746ac1245a8a112f0, disabling compactions & flushes 2023-02-17 22:01:02,654 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:02,654 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:02,655 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. after waiting 0 ms 2023-02-17 22:01:02,655 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:02,655 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:02,655 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:02,656 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e8a6a2ecf5feffda56c1e09b06327a85, NAME => 'testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,656 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,656 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 147da3b7bc4c9f656b0d17dbe4da4f7a, disabling compactions & flushes 2023-02-17 22:01:02,657 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:02,657 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:02,657 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. after waiting 0 ms 2023-02-17 22:01:02,657 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:02,657 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:02,657 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:02,658 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 000f98e14b87a35d74cccef96eb5d4bb, NAME => 'testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,661 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1d2f1305f30ba046ad3393e66fd54326, disabling compactions & flushes 2023-02-17 22:01:02,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:02,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:02,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. after waiting 0 ms 2023-02-17 22:01:02,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:02,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:02,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:02,663 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7337cfaa770067dbc7df44ebdfff7069, NAME => 'testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e8a6a2ecf5feffda56c1e09b06327a85, disabling compactions & flushes 2023-02-17 22:01:02,681 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:02,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:02,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. after waiting 0 ms 2023-02-17 22:01:02,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:02,682 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:02,682 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:02,682 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 505c138cee9ef6b3bf2af1613b430403, NAME => 'testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp 2023-02-17 22:01:02,699 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 000f98e14b87a35d74cccef96eb5d4bb, disabling compactions & flushes 2023-02-17 22:01:02,701 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:02,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:02,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. after waiting 0 ms 2023-02-17 22:01:02,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:02,701 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:02,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:02,707 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,707 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 7337cfaa770067dbc7df44ebdfff7069, disabling compactions & flushes 2023-02-17 22:01:02,708 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:02,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:02,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. after waiting 0 ms 2023-02-17 22:01:02,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:02,708 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:02,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:02,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:02,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 505c138cee9ef6b3bf2af1613b430403, disabling compactions & flushes 2023-02-17 22:01:02,722 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:02,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:02,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. after waiting 0 ms 2023-02-17 22:01:02,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:02,722 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:02,722 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:02,727 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:02,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,731 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,731 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671262728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671262728"}]},"ts":"1676671262728"} 2023-02-17 22:01:02,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:02,788 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 22:01:02,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:02,790 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671262789"}]},"ts":"1676671262789"} 2023-02-17 22:01:02,792 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 22:01:02,797 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:02,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:02,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:02,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:02,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, ASSIGN}] 2023-02-17 22:01:02,818 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, ASSIGN 2023-02-17 22:01:02,818 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, ASSIGN 2023-02-17 22:01:02,819 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, ASSIGN 2023-02-17 22:01:02,819 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, ASSIGN 2023-02-17 22:01:02,837 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45019,1676671259449; forceNewPlan=false, retain=false 2023-02-17 22:01:02,837 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36361,1676671259402; forceNewPlan=false, retain=false 2023-02-17 22:01:02,837 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36361,1676671259402; forceNewPlan=false, retain=false 2023-02-17 22:01:02,839 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45019,1676671259449; forceNewPlan=false, retain=false 2023-02-17 22:01:02,840 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, ASSIGN 2023-02-17 22:01:02,843 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, ASSIGN 2023-02-17 22:01:02,844 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, ASSIGN 2023-02-17 22:01:02,844 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, ASSIGN 2023-02-17 22:01:02,845 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, ASSIGN 2023-02-17 22:01:02,846 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45019,1676671259449; forceNewPlan=false, retain=false 2023-02-17 22:01:02,849 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36361,1676671259402; forceNewPlan=false, retain=false 2023-02-17 22:01:02,849 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36361,1676671259402; forceNewPlan=false, retain=false 2023-02-17 22:01:02,849 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45019,1676671259449; forceNewPlan=false, retain=false 2023-02-17 22:01:02,850 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45019,1676671259449; forceNewPlan=false, retain=false 2023-02-17 22:01:02,852 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, ASSIGN 2023-02-17 22:01:02,854 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36361,1676671259402; forceNewPlan=false, retain=false 2023-02-17 22:01:02,988 INFO [jenkins-hbase9:41817] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 22:01:02,992 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0937af50422382f74d368592fe0b5cd6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,992 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=000f98e14b87a35d74cccef96eb5d4bb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,992 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4601b8c33a946bf746ac1245a8a112f0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,992 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=505c138cee9ef6b3bf2af1613b430403, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,993 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671262992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671262992"}]},"ts":"1676671262992"} 2023-02-17 22:01:02,993 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671262992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671262992"}]},"ts":"1676671262992"} 2023-02-17 22:01:02,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671262992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671262992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671262992"}]},"ts":"1676671262992"} 2023-02-17 22:01:02,993 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671262992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671262992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671262992"}]},"ts":"1676671262992"} 2023-02-17 22:01:02,993 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1d2f1305f30ba046ad3393e66fd54326, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:02,994 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671262993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671262993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671262993"}]},"ts":"1676671262993"} 2023-02-17 22:01:02,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 000f98e14b87a35d74cccef96eb5d4bb, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:03,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 4601b8c33a946bf746ac1245a8a112f0, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:03,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 505c138cee9ef6b3bf2af1613b430403, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:03,007 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1c6eb348c1685ba893d7e098594b6a96, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,007 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671263007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671263007"}]},"ts":"1676671263007"} 2023-02-17 22:01:03,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 0937af50422382f74d368592fe0b5cd6, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:03,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure 1d2f1305f30ba046ad3393e66fd54326, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:03,014 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e8a6a2ecf5feffda56c1e09b06327a85, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671263014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671263014"}]},"ts":"1676671263014"} 2023-02-17 22:01:03,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 1c6eb348c1685ba893d7e098594b6a96, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:03,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=147da3b7bc4c9f656b0d17dbe4da4f7a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671263018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671263018"}]},"ts":"1676671263018"} 2023-02-17 22:01:03,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure e8a6a2ecf5feffda56c1e09b06327a85, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:03,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 147da3b7bc4c9f656b0d17dbe4da4f7a, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:03,027 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d701324d21e25a61c50e3e2d6bfdc5f6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,028 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671263027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671263027"}]},"ts":"1676671263027"} 2023-02-17 22:01:03,034 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7337cfaa770067dbc7df44ebdfff7069, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,035 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671263034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671263034"}]},"ts":"1676671263034"} 2023-02-17 22:01:03,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure d701324d21e25a61c50e3e2d6bfdc5f6, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:03,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 7337cfaa770067dbc7df44ebdfff7069, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:03,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:03,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:03,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 505c138cee9ef6b3bf2af1613b430403, NAME => 'testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 22:01:03,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,164 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,167 DEBUG [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f1 2023-02-17 22:01:03,167 DEBUG [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f1 2023-02-17 22:01:03,168 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 505c138cee9ef6b3bf2af1613b430403 columnFamilyName f1 2023-02-17 22:01:03,169 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(310): Store=505c138cee9ef6b3bf2af1613b430403/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,169 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,171 DEBUG [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f2 2023-02-17 22:01:03,171 DEBUG [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f2 2023-02-17 22:01:03,172 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 505c138cee9ef6b3bf2af1613b430403 columnFamilyName f2 2023-02-17 22:01:03,172 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(310): Store=505c138cee9ef6b3bf2af1613b430403/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:03,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e8a6a2ecf5feffda56c1e09b06327a85, NAME => 'testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 22:01:03,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:03,191 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 505c138cee9ef6b3bf2af1613b430403; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72035920, jitterRate=0.07341885566711426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:03,193 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1 2023-02-17 22:01:03,193 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1 2023-02-17 22:01:03,194 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a6a2ecf5feffda56c1e09b06327a85 columnFamilyName f1 2023-02-17 22:01:03,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403., pid=23, masterSystemTime=1676671263152 2023-02-17 22:01:03,194 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(310): Store=e8a6a2ecf5feffda56c1e09b06327a85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,195 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,197 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2 2023-02-17 22:01:03,198 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2 2023-02-17 22:01:03,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:03,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:03,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:03,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0937af50422382f74d368592fe0b5cd6, NAME => 'testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 22:01:03,198 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a6a2ecf5feffda56c1e09b06327a85 columnFamilyName f2 2023-02-17 22:01:03,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=505c138cee9ef6b3bf2af1613b430403, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:03,200 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(310): Store=e8a6a2ecf5feffda56c1e09b06327a85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671263199"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263199"}]},"ts":"1676671263199"} 2023-02-17 22:01:03,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,207 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,211 DEBUG [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f1 2023-02-17 22:01:03,212 DEBUG [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f1 2023-02-17 22:01:03,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,212 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0937af50422382f74d368592fe0b5cd6 columnFamilyName f1 2023-02-17 22:01:03,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-17 22:01:03,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 505c138cee9ef6b3bf2af1613b430403, server=jenkins-hbase9.apache.org,45019,1676671259449 in 205 msec 2023-02-17 22:01:03,215 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(310): Store=0937af50422382f74d368592fe0b5cd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,216 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:03,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, ASSIGN in 401 msec 2023-02-17 22:01:03,219 DEBUG [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f2 2023-02-17 22:01:03,219 DEBUG [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f2 2023-02-17 22:01:03,219 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0937af50422382f74d368592fe0b5cd6 columnFamilyName f2 2023-02-17 22:01:03,220 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(310): Store=0937af50422382f74d368592fe0b5cd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e8a6a2ecf5feffda56c1e09b06327a85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72122537, jitterRate=0.07470954954624176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:03,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85., pid=27, masterSystemTime=1676671263172 2023-02-17 22:01:03,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:03,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:03,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:03,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d701324d21e25a61c50e3e2d6bfdc5f6, NAME => 'testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 22:01:03,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,230 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e8a6a2ecf5feffda56c1e09b06327a85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,230 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263230"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263230"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263230"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263230"}]},"ts":"1676671263230"} 2023-02-17 22:01:03,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:03,232 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,236 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1 2023-02-17 22:01:03,236 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1 2023-02-17 22:01:03,237 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d701324d21e25a61c50e3e2d6bfdc5f6 columnFamilyName f1 2023-02-17 22:01:03,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 0937af50422382f74d368592fe0b5cd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69173199, jitterRate=0.0307609885931015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:03,239 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(310): Store=d701324d21e25a61c50e3e2d6bfdc5f6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,240 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6., pid=24, masterSystemTime=1676671263152 2023-02-17 22:01:03,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-17 22:01:03,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure e8a6a2ecf5feffda56c1e09b06327a85, server=jenkins-hbase9.apache.org,36361,1676671259402 in 214 msec 2023-02-17 22:01:03,244 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2 2023-02-17 22:01:03,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, ASSIGN in 427 msec 2023-02-17 22:01:03,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:03,244 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2 2023-02-17 22:01:03,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:03,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:03,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d2f1305f30ba046ad3393e66fd54326, NAME => 'testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 22:01:03,246 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0937af50422382f74d368592fe0b5cd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:03,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,246 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671263245"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263245"}]},"ts":"1676671263245"} 2023-02-17 22:01:03,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,247 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d701324d21e25a61c50e3e2d6bfdc5f6 columnFamilyName f2 2023-02-17 22:01:03,249 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(310): Store=d701324d21e25a61c50e3e2d6bfdc5f6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,250 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,253 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1 2023-02-17 22:01:03,253 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1 2023-02-17 22:01:03,253 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2f1305f30ba046ad3393e66fd54326 columnFamilyName f1 2023-02-17 22:01:03,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-17 22:01:03,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 0937af50422382f74d368592fe0b5cd6, server=jenkins-hbase9.apache.org,45019,1676671259449 in 240 msec 2023-02-17 22:01:03,256 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(310): Store=1d2f1305f30ba046ad3393e66fd54326/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,256 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, ASSIGN in 440 msec 2023-02-17 22:01:03,259 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2 2023-02-17 22:01:03,259 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2 2023-02-17 22:01:03,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:03,260 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2f1305f30ba046ad3393e66fd54326 columnFamilyName f2 2023-02-17 22:01:03,260 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(310): Store=1d2f1305f30ba046ad3393e66fd54326/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d701324d21e25a61c50e3e2d6bfdc5f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72765544, jitterRate=0.08429110050201416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:03,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6., pid=29, masterSystemTime=1676671263172 2023-02-17 22:01:03,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:03,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:03,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:03,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:03,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 147da3b7bc4c9f656b0d17dbe4da4f7a, NAME => 'testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 22:01:03,268 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d701324d21e25a61c50e3e2d6bfdc5f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,268 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263268"}]},"ts":"1676671263268"} 2023-02-17 22:01:03,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,276 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1d2f1305f30ba046ad3393e66fd54326; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74231080, jitterRate=0.10612928867340088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:03,279 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1 2023-02-17 22:01:03,279 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1 2023-02-17 22:01:03,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326., pid=25, masterSystemTime=1676671263152 2023-02-17 22:01:03,279 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 147da3b7bc4c9f656b0d17dbe4da4f7a columnFamilyName f1 2023-02-17 22:01:03,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-17 22:01:03,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure d701324d21e25a61c50e3e2d6bfdc5f6, server=jenkins-hbase9.apache.org,36361,1676671259402 in 236 msec 2023-02-17 22:01:03,280 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(310): Store=147da3b7bc4c9f656b0d17dbe4da4f7a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,281 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:03,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:03,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:03,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 000f98e14b87a35d74cccef96eb5d4bb, NAME => 'testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 22:01:03,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, ASSIGN in 465 msec 2023-02-17 22:01:03,283 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1d2f1305f30ba046ad3393e66fd54326, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:03,284 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263283"}]},"ts":"1676671263283"} 2023-02-17 22:01:03,284 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2 2023-02-17 22:01:03,284 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2 2023-02-17 22:01:03,285 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 147da3b7bc4c9f656b0d17dbe4da4f7a columnFamilyName f2 2023-02-17 22:01:03,285 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,286 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(310): Store=147da3b7bc4c9f656b0d17dbe4da4f7a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,291 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1 2023-02-17 22:01:03,291 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1 2023-02-17 22:01:03,291 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 000f98e14b87a35d74cccef96eb5d4bb columnFamilyName f1 2023-02-17 22:01:03,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-17 22:01:03,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure 1d2f1305f30ba046ad3393e66fd54326, server=jenkins-hbase9.apache.org,45019,1676671259449 in 276 msec 2023-02-17 22:01:03,295 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(310): Store=000f98e14b87a35d74cccef96eb5d4bb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,295 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, ASSIGN in 480 msec 2023-02-17 22:01:03,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,300 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2 2023-02-17 22:01:03,300 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2 2023-02-17 22:01:03,301 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 000f98e14b87a35d74cccef96eb5d4bb columnFamilyName f2 2023-02-17 22:01:03,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:03,302 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(310): Store=000f98e14b87a35d74cccef96eb5d4bb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:03,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 147da3b7bc4c9f656b0d17dbe4da4f7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72200069, jitterRate=0.07586486637592316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:03,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a., pid=28, masterSystemTime=1676671263172 2023-02-17 22:01:03,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 000f98e14b87a35d74cccef96eb5d4bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70348940, jitterRate=0.04828089475631714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:03,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb., pid=21, masterSystemTime=1676671263152 2023-02-17 22:01:03,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:03,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:03,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:03,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1c6eb348c1685ba893d7e098594b6a96, NAME => 'testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 22:01:03,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,319 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=147da3b7bc4c9f656b0d17dbe4da4f7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,319 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263318"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263318"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263318"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263318"}]},"ts":"1676671263318"} 2023-02-17 22:01:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:03,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:03,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4601b8c33a946bf746ac1245a8a112f0, NAME => 'testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 22:01:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,320 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=000f98e14b87a35d74cccef96eb5d4bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:03,321 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263320"}]},"ts":"1676671263320"} 2023-02-17 22:01:03,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-17 22:01:03,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 147da3b7bc4c9f656b0d17dbe4da4f7a, server=jenkins-hbase9.apache.org,36361,1676671259402 in 299 msec 2023-02-17 22:01:03,327 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-17 22:01:03,327 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 000f98e14b87a35d74cccef96eb5d4bb, server=jenkins-hbase9.apache.org,45019,1676671259449 in 326 msec 2023-02-17 22:01:03,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, ASSIGN in 512 msec 2023-02-17 22:01:03,330 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1 2023-02-17 22:01:03,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, ASSIGN in 513 msec 2023-02-17 22:01:03,330 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1 2023-02-17 22:01:03,330 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1 2023-02-17 22:01:03,331 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4601b8c33a946bf746ac1245a8a112f0 columnFamilyName f1 2023-02-17 22:01:03,330 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1 2023-02-17 22:01:03,331 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6eb348c1685ba893d7e098594b6a96 columnFamilyName f1 2023-02-17 22:01:03,331 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(310): Store=4601b8c33a946bf746ac1245a8a112f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,332 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,332 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(310): Store=1c6eb348c1685ba893d7e098594b6a96/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,332 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,333 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2 2023-02-17 22:01:03,333 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2 2023-02-17 22:01:03,334 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4601b8c33a946bf746ac1245a8a112f0 columnFamilyName f2 2023-02-17 22:01:03,334 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2 2023-02-17 22:01:03,334 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2 2023-02-17 22:01:03,334 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6eb348c1685ba893d7e098594b6a96 columnFamilyName f2 2023-02-17 22:01:03,335 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(310): Store=4601b8c33a946bf746ac1245a8a112f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,336 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(310): Store=1c6eb348c1685ba893d7e098594b6a96/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:03,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:03,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1c6eb348c1685ba893d7e098594b6a96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68689656, jitterRate=0.023555636405944824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 4601b8c33a946bf746ac1245a8a112f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71034617, jitterRate=0.05849827826023102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:03,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:03,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96., pid=26, masterSystemTime=1676671263172 2023-02-17 22:01:03,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0., pid=22, masterSystemTime=1676671263152 2023-02-17 22:01:03,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:03,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:03,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:03,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7337cfaa770067dbc7df44ebdfff7069, NAME => 'testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 22:01:03,350 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1c6eb348c1685ba893d7e098594b6a96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,351 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263350"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263350"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263350"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263350"}]},"ts":"1676671263350"} 2023-02-17 22:01:03,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:03,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:03,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:03,352 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4601b8c33a946bf746ac1245a8a112f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:03,353 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263352"}]},"ts":"1676671263352"} 2023-02-17 22:01:03,359 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,361 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1 2023-02-17 22:01:03,361 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1 2023-02-17 22:01:03,362 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7337cfaa770067dbc7df44ebdfff7069 columnFamilyName f1 2023-02-17 22:01:03,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-17 22:01:03,363 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(310): Store=7337cfaa770067dbc7df44ebdfff7069/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 1c6eb348c1685ba893d7e098594b6a96, server=jenkins-hbase9.apache.org,36361,1676671259402 in 343 msec 2023-02-17 22:01:03,363 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-17 22:01:03,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 4601b8c33a946bf746ac1245a8a112f0, server=jenkins-hbase9.apache.org,45019,1676671259449 in 358 msec 2023-02-17 22:01:03,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, ASSIGN in 549 msec 2023-02-17 22:01:03,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, ASSIGN in 550 msec 2023-02-17 22:01:03,366 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2 2023-02-17 22:01:03,366 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2 2023-02-17 22:01:03,367 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7337cfaa770067dbc7df44ebdfff7069 columnFamilyName f2 2023-02-17 22:01:03,367 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(310): Store=7337cfaa770067dbc7df44ebdfff7069/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:03,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:03,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:03,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:03,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7337cfaa770067dbc7df44ebdfff7069; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67134252, jitterRate=3.783106803894043E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:03,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:03,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069., pid=30, masterSystemTime=1676671263172 2023-02-17 22:01:03,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:03,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:03,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7337cfaa770067dbc7df44ebdfff7069, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:03,383 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671263383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671263383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671263383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671263383"}]},"ts":"1676671263383"} 2023-02-17 22:01:03,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-17 22:01:03,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 7337cfaa770067dbc7df44ebdfff7069, server=jenkins-hbase9.apache.org,36361,1676671259402 in 346 msec 2023-02-17 22:01:03,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-17 22:01:03,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, ASSIGN in 575 msec 2023-02-17 22:01:03,394 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:03,394 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671263394"}]},"ts":"1676671263394"} 2023-02-17 22:01:03,396 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 22:01:03,399 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:03,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 964 msec 2023-02-17 22:01:03,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:03,590 INFO [Listener at localhost/34531] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 22:01:03,591 DEBUG [Listener at localhost/34531] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 22:01:03,593 INFO [Listener at localhost/34531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:03,602 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 22:01:03,603 INFO [Listener at localhost/34531] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:03,604 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 22:01:03,604 INFO [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:03,747 DEBUG [hconnection-0x34dbfb0-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:03,815 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:03,855 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:03,862 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36361] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:04,176 INFO [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:04,180 INFO [Listener at localhost/34531] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:04,194 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:04,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671264194 (current time:1676671264194). 2023-02-17 22:01:04,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:04,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] zookeeper.ReadOnlyZKClient(139): Connect 0x2205c366 to 127.0.0.1:52138 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:04,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c653cf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:04,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:04,208 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:04,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2205c366 to 127.0.0.1:52138 2023-02-17 22:01:04,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:04,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:04,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:04,235 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:04,237 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676671864237 2023-02-17 22:01:04,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:04,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 22:01:04,240 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:04,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:04,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 14 msec 2023-02-17 22:01:04,243 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:04,244 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676671864244 2023-02-17 22:01:04,244 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:04,244 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:04,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-17 22:01:04,282 INFO [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-17 22:01:04,283 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:04,283 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-17 22:01:04,283 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 22:01:04,284 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:04,285 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:04,287 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:04,287 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:04,287 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:04,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:04,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:04,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:04,288 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,288 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:04,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:04,290 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,290 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:04,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:04,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-17 22:01:04,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:04,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 22:01:04,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-17 22:01:04,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:04,294 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 22:01:04,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-17 22:01:04,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-17 22:01:04,295 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-17 22:01:04,295 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:04,295 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-17 22:01:04,296 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:04,296 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 22:01:04,297 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 22:01:04,297 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-17 22:01:04,297 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-17 22:01:04,297 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36361,1676671259402' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-17 22:01:04,297 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45019,1676671259449' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-17 22:01:04,300 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,300 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:04,300 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,300 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,300 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,300 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:04,301 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,301 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:04,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:04,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36361,1676671259402' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-17 22:01:04,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3848a2ff[Count = 1] remaining members to acquire global barrier 2023-02-17 22:01:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:04,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45019,1676671259449' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-17 22:01:04,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3848a2ff[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:04,307 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 22:01:04,307 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:04,309 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,309 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:04,309 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:04,309 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,309 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:04,310 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:04,310 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:04,310 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. started... 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. started... 2023-02-17 22:01:04,310 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:04,311 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. started... 2023-02-17 22:01:04,311 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. started... 2023-02-17 22:01:04,310 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 22:01:04,311 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. started... 2023-02-17 22:01:04,311 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. started... 2023-02-17 22:01:04,313 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e8a6a2ecf5feffda56c1e09b06327a85 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:04,320 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:04,323 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d701324d21e25a61c50e3e2d6bfdc5f6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 22:01:04,324 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 000f98e14b87a35d74cccef96eb5d4bb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:04,324 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7337cfaa770067dbc7df44ebdfff7069 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 22:01:04,323 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1d2f1305f30ba046ad3393e66fd54326 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:04,325 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,345 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:04,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:04,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:04,350 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,350 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:04,355 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:04,355 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:04,410 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. completed. 2023-02-17 22:01:04,410 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:04,411 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:04,411 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 22:01:04,411 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. started... 2023-02-17 22:01:04,412 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:04,412 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,412 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,412 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:04,412 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:04,484 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. completed. 2023-02-17 22:01:04,484 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:04,484 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:04,484 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. started... 2023-02-17 22:01:04,485 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4601b8c33a946bf746ac1245a8a112f0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:04,487 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 22:01:04,554 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:04,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:04,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:04,558 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 22:01:04,659 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f1/df3416924e724009ad67006102ffbeec 2023-02-17 22:01:04,696 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f1/3dac1b2185324f14859f2966aa4dbfce 2023-02-17 22:01:04,696 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f1/5a1b468cb960424886748b60a1c723fc 2023-02-17 22:01:04,697 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f1/096aff7795984b7aa5af978c982cd711 2023-02-17 22:01:04,707 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f1/af73bdb49462418291d3ae08f1c5b33f 2023-02-17 22:01:04,819 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f2/02bba417285f4b2db6e92077a09318e8 2023-02-17 22:01:04,836 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f1/df3416924e724009ad67006102ffbeec as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/df3416924e724009ad67006102ffbeec 2023-02-17 22:01:04,840 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f2/2cddabef8bad46e0a2f57a5a20bec307 2023-02-17 22:01:04,843 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f2/5e3dd9101cf2482ea8b87dfb35e17223 2023-02-17 22:01:04,849 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f2/9e7eae850b37472284ae1014ca6ba554 2023-02-17 22:01:04,852 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/df3416924e724009ad67006102ffbeec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,853 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f1/5a1b468cb960424886748b60a1c723fc as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/5a1b468cb960424886748b60a1c723fc 2023-02-17 22:01:04,855 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f2/49e9da09cae7437c94c159b919a3baa7 2023-02-17 22:01:04,857 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f1/096aff7795984b7aa5af978c982cd711 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/096aff7795984b7aa5af978c982cd711 2023-02-17 22:01:04,858 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:04,858 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f2/02bba417285f4b2db6e92077a09318e8 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/02bba417285f4b2db6e92077a09318e8 2023-02-17 22:01:04,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:04,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:04,860 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 22:01:04,866 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f1/3dac1b2185324f14859f2966aa4dbfce as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/3dac1b2185324f14859f2966aa4dbfce 2023-02-17 22:01:04,867 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/5a1b468cb960424886748b60a1c723fc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,870 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f2/2cddabef8bad46e0a2f57a5a20bec307 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/2cddabef8bad46e0a2f57a5a20bec307 2023-02-17 22:01:04,873 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f1/af73bdb49462418291d3ae08f1c5b33f as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/af73bdb49462418291d3ae08f1c5b33f 2023-02-17 22:01:04,876 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/096aff7795984b7aa5af978c982cd711, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,877 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/3dac1b2185324f14859f2966aa4dbfce, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:04,877 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f2/5e3dd9101cf2482ea8b87dfb35e17223 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/5e3dd9101cf2482ea8b87dfb35e17223 2023-02-17 22:01:04,878 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/02bba417285f4b2db6e92077a09318e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,879 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f2/9e7eae850b37472284ae1014ca6ba554 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/9e7eae850b37472284ae1014ca6ba554 2023-02-17 22:01:04,879 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 000f98e14b87a35d74cccef96eb5d4bb in 556ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:04,881 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 22:01:04,884 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:04,884 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/2cddabef8bad46e0a2f57a5a20bec307, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,884 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,884 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,885 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/df3416924e724009ad67006102ffbeec] hfiles 2023-02-17 22:01:04,885 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/df3416924e724009ad67006102ffbeec for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,886 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4601b8c33a946bf746ac1245a8a112f0 in 400ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:04,888 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:04,889 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,889 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,889 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/5a1b468cb960424886748b60a1c723fc] hfiles 2023-02-17 22:01:04,889 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/5a1b468cb960424886748b60a1c723fc for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,890 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/af73bdb49462418291d3ae08f1c5b33f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,892 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f2/49e9da09cae7437c94c159b919a3baa7 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/49e9da09cae7437c94c159b919a3baa7 2023-02-17 22:01:04,893 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/02bba417285f4b2db6e92077a09318e8] hfiles 2023-02-17 22:01:04,893 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/02bba417285f4b2db6e92077a09318e8 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,893 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/2cddabef8bad46e0a2f57a5a20bec307] hfiles 2023-02-17 22:01:04,893 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/2cddabef8bad46e0a2f57a5a20bec307 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,896 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/9e7eae850b37472284ae1014ca6ba554, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:04,897 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d701324d21e25a61c50e3e2d6bfdc5f6 in 577ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:04,897 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:04,897 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,897 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,898 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/3dac1b2185324f14859f2966aa4dbfce] hfiles 2023-02-17 22:01:04,898 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/3dac1b2185324f14859f2966aa4dbfce for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,898 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/9e7eae850b37472284ae1014ca6ba554] hfiles 2023-02-17 22:01:04,898 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/9e7eae850b37472284ae1014ca6ba554 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,910 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/49e9da09cae7437c94c159b919a3baa7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,911 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e8a6a2ecf5feffda56c1e09b06327a85 in 599ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:04,911 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:04,911 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/5e3dd9101cf2482ea8b87dfb35e17223, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:04,912 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,912 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,912 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/af73bdb49462418291d3ae08f1c5b33f] hfiles 2023-02-17 22:01:04,912 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/af73bdb49462418291d3ae08f1c5b33f for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,912 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/49e9da09cae7437c94c159b919a3baa7] hfiles 2023-02-17 22:01:04,912 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/49e9da09cae7437c94c159b919a3baa7 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,913 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1d2f1305f30ba046ad3393e66fd54326 in 592ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/096aff7795984b7aa5af978c982cd711] hfiles 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/096aff7795984b7aa5af978c982cd711 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/5e3dd9101cf2482ea8b87dfb35e17223] hfiles 2023-02-17 22:01:04,913 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/5e3dd9101cf2482ea8b87dfb35e17223 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:04,927 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. completed. 2023-02-17 22:01:04,927 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:04,927 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:04,927 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 22:01:04,927 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. started... 2023-02-17 22:01:04,928 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. completed. 2023-02-17 22:01:04,928 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:04,928 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 22:01:04,930 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1c6eb348c1685ba893d7e098594b6a96 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:04,935 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. completed. 2023-02-17 22:01:04,935 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:04,935 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 22:01:04,946 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. completed. 2023-02-17 22:01:04,946 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:04,946 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:04,946 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 22:01:04,946 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. started... 2023-02-17 22:01:04,946 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. completed. 2023-02-17 22:01:04,947 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:04,947 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 147da3b7bc4c9f656b0d17dbe4da4f7a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:04,947 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 22:01:04,947 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 22:01:04,947 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,948 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-17 22:01:04,948 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,45019,1676671259449' in zk 2023-02-17 22:01:04,954 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:04,954 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-17 22:01:04,954 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:04,955 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-17 22:01:04,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:04,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,45019,1676671259449': 2023-02-17 22:01:04,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45019,1676671259449' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 22:01:04,981 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f1/8c09f94ed551445a89d800a7a248fb47 2023-02-17 22:01:04,986 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f1/be3bf56484c141f6a6ab992b484ad796 2023-02-17 22:01:05,024 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f2/decde84c1d074489ab112214e51e6c04 2023-02-17 22:01:05,035 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f1/be3bf56484c141f6a6ab992b484ad796 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/be3bf56484c141f6a6ab992b484ad796 2023-02-17 22:01:05,046 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/be3bf56484c141f6a6ab992b484ad796, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:05,048 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f2/3a8127ba80614a66a47e2753d4f13c20 2023-02-17 22:01:05,049 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f2/decde84c1d074489ab112214e51e6c04 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/decde84c1d074489ab112214e51e6c04 2023-02-17 22:01:05,057 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f1/8c09f94ed551445a89d800a7a248fb47 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/8c09f94ed551445a89d800a7a248fb47 2023-02-17 22:01:05,058 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/decde84c1d074489ab112214e51e6c04, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:05,059 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 147da3b7bc4c9f656b0d17dbe4da4f7a in 112ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:05,059 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:05,059 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,059 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:05,060 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/be3bf56484c141f6a6ab992b484ad796] hfiles 2023-02-17 22:01:05,060 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/be3bf56484c141f6a6ab992b484ad796 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,060 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/decde84c1d074489ab112214e51e6c04] hfiles 2023-02-17 22:01:05,060 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/decde84c1d074489ab112214e51e6c04 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,066 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/8c09f94ed551445a89d800a7a248fb47, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:05,068 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f2/3a8127ba80614a66a47e2753d4f13c20 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/3a8127ba80614a66a47e2753d4f13c20 2023-02-17 22:01:05,095 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. completed. 2023-02-17 22:01:05,095 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:05,095 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 22:01:05,099 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f1/0d48dc0777d24ef49eb3576da32d1302 2023-02-17 22:01:05,100 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/3a8127ba80614a66a47e2753d4f13c20, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:05,102 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1c6eb348c1685ba893d7e098594b6a96 in 173ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/8c09f94ed551445a89d800a7a248fb47] hfiles 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/8c09f94ed551445a89d800a7a248fb47 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/3a8127ba80614a66a47e2753d4f13c20] hfiles 2023-02-17 22:01:05,102 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/3a8127ba80614a66a47e2753d4f13c20 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,132 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f2/e54d0d01bc3b46feb53bc61f55d6d183 2023-02-17 22:01:05,141 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f1/0d48dc0777d24ef49eb3576da32d1302 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/0d48dc0777d24ef49eb3576da32d1302 2023-02-17 22:01:05,146 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. completed. 2023-02-17 22:01:05,146 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:05,146 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 22:01:05,150 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/0d48dc0777d24ef49eb3576da32d1302, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:05,151 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f2/e54d0d01bc3b46feb53bc61f55d6d183 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/e54d0d01bc3b46feb53bc61f55d6d183 2023-02-17 22:01:05,160 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/e54d0d01bc3b46feb53bc61f55d6d183, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:05,162 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7337cfaa770067dbc7df44ebdfff7069 in 839ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:05,162 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:05,162 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,162 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:05,162 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/0d48dc0777d24ef49eb3576da32d1302] hfiles 2023-02-17 22:01:05,162 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/0d48dc0777d24ef49eb3576da32d1302 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,163 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/e54d0d01bc3b46feb53bc61f55d6d183] hfiles 2023-02-17 22:01:05,163 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/e54d0d01bc3b46feb53bc61f55d6d183 for snapshot=testWithMapReduceMultiRegion 2023-02-17 22:01:05,175 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. completed. 2023-02-17 22:01:05,175 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:05,175 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 22:01:05,175 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 22:01:05,175 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,175 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-17 22:01:05,175 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,36361,1676671259402' in zk 2023-02-17 22:01:05,178 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-17 22:01:05,178 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:05,178 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,178 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-17 22:01:05,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:05,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:05,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:05,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:05,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:05,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,36361,1676671259402': 2023-02-17 22:01:05,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36361,1676671259402' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:05,185 INFO [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-17 22:01:05,185 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:05,185 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:05,185 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-17 22:01:05,185 INFO [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:05,188 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,188 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,188 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,189 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:05,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:05,188 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:05,189 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:05,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,190 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:05,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,193 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,194 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 22:01:05,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,219 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:05,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:05,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:05,219 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,219 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:05,219 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:05,219 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:05,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 22:01:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:05,220 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:05,220 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 22:01:05,221 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 22:01:05,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-17 22:01:05,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-17 22:01:05,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 22:01:05,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-17 22:01:05,360 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:05,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:05,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:05,363 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-17 22:01:05,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-17 22:01:05,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 22:01:05,412 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 22:01:05,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676671264238Consolidate snapshot: testWithMapReduceMultiRegion at 1676671265222 (+984 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676671265222Writing data manifest for testWithMapReduceMultiRegion at 1676671265282 (+60 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676671265308 (+26 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676671265411 (+103 ms) 2023-02-17 22:01:05,413 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:05,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1740 sec 2023-02-17 22:01:06,363 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:06,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:06,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:06,365 INFO [Listener at localhost/34531] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:06,378 INFO [Listener at localhost/34531] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:06,389 INFO [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:06,454 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:06,467 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36361] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:06,597 INFO [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:06,616 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:06,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 22:01:06,620 INFO [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 22:01:06,620 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:06,621 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 22:01:06,621 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 22:01:06,622 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:06,622 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:06,623 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:06,623 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:06,623 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:06,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:06,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:06,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:06,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:06,624 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:06,624 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:06,624 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:06,624 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:06,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:06,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 22:01:06,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 22:01:06,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 22:01:06,627 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 22:01:06,627 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:06,627 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 22:01:06,628 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:06,628 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 22:01:06,629 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 22:01:06,630 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:06,630 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. started... 2023-02-17 22:01:06,630 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e8a6a2ecf5feffda56c1e09b06327a85 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:06,631 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:06,631 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. started... 2023-02-17 22:01:06,631 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:06,631 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:06,635 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:06,635 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 22:01:06,635 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. started... 2023-02-17 22:01:06,636 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:06,636 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 22:01:06,636 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:06,636 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7337cfaa770067dbc7df44ebdfff7069 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 22:01:06,635 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:06,636 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. started... 2023-02-17 22:01:06,636 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:06,637 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 22:01:06,636 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:06,637 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1d2f1305f30ba046ad3393e66fd54326 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:06,636 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:06,637 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. started... 2023-02-17 22:01:06,638 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d701324d21e25a61c50e3e2d6bfdc5f6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 22:01:06,637 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. started... 2023-02-17 22:01:06,638 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:06,638 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:06,638 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:06,638 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. started... 2023-02-17 22:01:06,638 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 22:01:06,638 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4601b8c33a946bf746ac1245a8a112f0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:06,636 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. started... 2023-02-17 22:01:06,640 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 000f98e14b87a35d74cccef96eb5d4bb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:06,719 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f1/26792cb258cd484c9adea53fc02c9f05 2023-02-17 22:01:06,720 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f1/45fbcbee894d4f949b8c6834cf51b43f 2023-02-17 22:01:06,736 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f1/d71a855c3a42441190af3d55940af273 2023-02-17 22:01:06,736 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f1/b1ed986ed4794e9791bc09a19f6f862f 2023-02-17 22:01:06,742 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f1/0a2436f402134fff9e949a6f28237f62 2023-02-17 22:01:06,782 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f2/fc8e43bd3dca4c3f97862437af8bd172 2023-02-17 22:01:06,795 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f1/26792cb258cd484c9adea53fc02c9f05 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/26792cb258cd484c9adea53fc02c9f05 2023-02-17 22:01:06,804 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/26792cb258cd484c9adea53fc02c9f05, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:06,805 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/.tmp/f2/fc8e43bd3dca4c3f97862437af8bd172 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/fc8e43bd3dca4c3f97862437af8bd172 2023-02-17 22:01:06,818 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/fc8e43bd3dca4c3f97862437af8bd172, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:06,819 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 000f98e14b87a35d74cccef96eb5d4bb in 179ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:06,820 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:06,820 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:06,820 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 22:01:06,838 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-17 22:01:06,874 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f2/c49a74e9ff2f4858a3852961b17e6548 2023-02-17 22:01:06,891 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f2/142e47598264453692be970713f2e0ed 2023-02-17 22:01:06,895 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f1/45fbcbee894d4f949b8c6834cf51b43f as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/45fbcbee894d4f949b8c6834cf51b43f 2023-02-17 22:01:06,924 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f1/b1ed986ed4794e9791bc09a19f6f862f as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/b1ed986ed4794e9791bc09a19f6f862f 2023-02-17 22:01:06,931 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/45fbcbee894d4f949b8c6834cf51b43f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:06,937 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/.tmp/f2/c49a74e9ff2f4858a3852961b17e6548 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/c49a74e9ff2f4858a3852961b17e6548 2023-02-17 22:01:06,939 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/b1ed986ed4794e9791bc09a19f6f862f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:06,941 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/.tmp/f2/142e47598264453692be970713f2e0ed as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/142e47598264453692be970713f2e0ed 2023-02-17 22:01:06,945 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/c49a74e9ff2f4858a3852961b17e6548, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:06,947 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7337cfaa770067dbc7df44ebdfff7069 in 311ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:06,947 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:06,947 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:06,947 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 22:01:06,947 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:06,947 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. started... 2023-02-17 22:01:06,947 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1c6eb348c1685ba893d7e098594b6a96 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:06,964 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/142e47598264453692be970713f2e0ed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:06,965 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e8a6a2ecf5feffda56c1e09b06327a85 in 335ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:06,966 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:06,966 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:06,966 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:06,966 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 22:01:06,966 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. started... 2023-02-17 22:01:06,966 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 147da3b7bc4c9f656b0d17dbe4da4f7a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:06,987 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-17 22:01:06,989 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-17 22:01:06,991 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f1/c19079d437424522b1cfe0271c388dba 2023-02-17 22:01:07,000 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f1/05c1f83228ec430f842a54dff955a949 2023-02-17 22:01:07,015 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f2/cab4d0a6b6ab456cacc0ef39a0c6422c 2023-02-17 22:01:07,019 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f2/759bdf726b0845338d01fa27f62b7a87 2023-02-17 22:01:07,022 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f1/c19079d437424522b1cfe0271c388dba as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/c19079d437424522b1cfe0271c388dba 2023-02-17 22:01:07,027 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f1/05c1f83228ec430f842a54dff955a949 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/05c1f83228ec430f842a54dff955a949 2023-02-17 22:01:07,028 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/c19079d437424522b1cfe0271c388dba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,029 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/.tmp/f2/cab4d0a6b6ab456cacc0ef39a0c6422c as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/cab4d0a6b6ab456cacc0ef39a0c6422c 2023-02-17 22:01:07,033 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/05c1f83228ec430f842a54dff955a949, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,034 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/.tmp/f2/759bdf726b0845338d01fa27f62b7a87 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/759bdf726b0845338d01fa27f62b7a87 2023-02-17 22:01:07,036 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/cab4d0a6b6ab456cacc0ef39a0c6422c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,037 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1c6eb348c1685ba893d7e098594b6a96 in 90ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:07,037 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:07,037 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:07,037 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 22:01:07,042 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/759bdf726b0845338d01fa27f62b7a87, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,043 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 147da3b7bc4c9f656b0d17dbe4da4f7a in 77ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:07,044 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:07,044 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:07,044 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 22:01:07,125 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f1/bd1479e67a974f9584c0c7bb0a208a58 2023-02-17 22:01:07,140 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f2/2c841772b83c45e6bb82e0d4a142a6d5 2023-02-17 22:01:07,148 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f1/bd1479e67a974f9584c0c7bb0a208a58 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/bd1479e67a974f9584c0c7bb0a208a58 2023-02-17 22:01:07,153 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/bd1479e67a974f9584c0c7bb0a208a58, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,155 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/.tmp/f2/2c841772b83c45e6bb82e0d4a142a6d5 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/2c841772b83c45e6bb82e0d4a142a6d5 2023-02-17 22:01:07,160 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/2c841772b83c45e6bb82e0d4a142a6d5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,161 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1d2f1305f30ba046ad3393e66fd54326 in 524ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:07,161 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:07,161 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:07,161 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 22:01:07,284 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f2/6fe7d1f56e2b4d6bad672818e0fb9dc2 2023-02-17 22:01:07,285 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f2/6e788ea36761440e977d93d1a07f598c 2023-02-17 22:01:07,292 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f1/0a2436f402134fff9e949a6f28237f62 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/0a2436f402134fff9e949a6f28237f62 2023-02-17 22:01:07,292 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f1/d71a855c3a42441190af3d55940af273 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/d71a855c3a42441190af3d55940af273 2023-02-17 22:01:07,298 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/0a2436f402134fff9e949a6f28237f62, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,298 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/d71a855c3a42441190af3d55940af273, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:07,299 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/.tmp/f2/6e788ea36761440e977d93d1a07f598c as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/6e788ea36761440e977d93d1a07f598c 2023-02-17 22:01:07,299 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/.tmp/f2/6fe7d1f56e2b4d6bad672818e0fb9dc2 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/6fe7d1f56e2b4d6bad672818e0fb9dc2 2023-02-17 22:01:07,305 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/6e788ea36761440e977d93d1a07f598c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:07,305 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/6fe7d1f56e2b4d6bad672818e0fb9dc2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:07,306 INFO [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4601b8c33a946bf746ac1245a8a112f0 in 668ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:07,306 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:07,306 DEBUG [rs(jenkins-hbase9.apache.org,45019,1676671259449)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:07,306 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 22:01:07,306 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 22:01:07,306 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,306 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 22:01:07,306 INFO [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d701324d21e25a61c50e3e2d6bfdc5f6 in 668ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:07,306 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45019,1676671259449' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 22:01:07,306 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:07,306 DEBUG [rs(jenkins-hbase9.apache.org,36361,1676671259402)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:07,307 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 22:01:07,307 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 22:01:07,307 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,307 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 22:01:07,307 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36361,1676671259402' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 22:01:07,309 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,309 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:07,310 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,310 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:07,310 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:07,310 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,310 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,310 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45019,1676671259449' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae85590[Count = 1] remaining members to acquire global barrier 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:07,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36361,1676671259402' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 22:01:07,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae85590[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:07,315 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 22:01:07,315 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,318 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,318 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,319 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 22:01:07,319 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 22:01:07,319 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 22:01:07,319 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,36361,1676671259402' in zk 2023-02-17 22:01:07,319 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 22:01:07,319 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,319 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,45019,1676671259449' in zk 2023-02-17 22:01:07,319 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,319 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:07,321 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,321 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 22:01:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:07,321 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:07,321 DEBUG [member: 'jenkins-hbase9.apache.org,36361,1676671259402' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 22:01:07,322 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 22:01:07,322 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,322 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:07,322 DEBUG [member: 'jenkins-hbase9.apache.org,45019,1676671259449' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 22:01:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,36361,1676671259402': 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36361,1676671259402' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,45019,1676671259449': 2023-02-17 22:01:07,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45019,1676671259449' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 22:01:07,329 INFO [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 22:01:07,329 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:07,329 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:07,329 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 22:01:07,330 INFO [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:07,332 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:07,332 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:07,332 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:07,333 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:07,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,333 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,336 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:07,336 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:07,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,343 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:07,343 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:07,343 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:07,342 DEBUG [(jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:07,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:07,342 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:07,342 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 22:01:07,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:07,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:07,346 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:07,346 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:07,446 DEBUG [Listener at localhost/34531] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:07,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:07,549 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop-794806644241760034.jar 2023-02-17 22:01:07,566 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676671264194 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:07,568 DEBUG [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce 2023-02-17 22:01:07,568 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:07,568 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:07,568 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(239): region to add: 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=505c138cee9ef6b3bf2af1613b430403 as 505c138cee9ef6b3bf2af1613b430403 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,569 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=e8a6a2ecf5feffda56c1e09b06327a85 as e8a6a2ecf5feffda56c1e09b06327a85 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=7337cfaa770067dbc7df44ebdfff7069 as 7337cfaa770067dbc7df44ebdfff7069 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=000f98e14b87a35d74cccef96eb5d4bb as 000f98e14b87a35d74cccef96eb5d4bb in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=d701324d21e25a61c50e3e2d6bfdc5f6 as d701324d21e25a61c50e3e2d6bfdc5f6 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=1c6eb348c1685ba893d7e098594b6a96 as 1c6eb348c1685ba893d7e098594b6a96 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=1d2f1305f30ba046ad3393e66fd54326 as 1d2f1305f30ba046ad3393e66fd54326 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=0937af50422382f74d368592fe0b5cd6 as 0937af50422382f74d368592fe0b5cd6 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=4601b8c33a946bf746ac1245a8a112f0 as 4601b8c33a946bf746ac1245a8a112f0 in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,570 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(585): clone region=147da3b7bc4c9f656b0d17dbe4da4f7a as 147da3b7bc4c9f656b0d17dbe4da4f7a in snapshot testWithMapReduceMultiRegion 2023-02-17 22:01:07,575 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 000f98e14b87a35d74cccef96eb5d4bb, NAME => 'testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,575 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7337cfaa770067dbc7df44ebdfff7069, NAME => 'testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,575 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d701324d21e25a61c50e3e2d6bfdc5f6, NAME => 'testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,575 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 1c6eb348c1685ba893d7e098594b6a96, NAME => 'testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,575 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e8a6a2ecf5feffda56c1e09b06327a85, NAME => 'testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,576 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0937af50422382f74d368592fe0b5cd6, NAME => 'testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,576 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 505c138cee9ef6b3bf2af1613b430403, NAME => 'testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,576 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 1d2f1305f30ba046ad3393e66fd54326, NAME => 'testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,594 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,595 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0d48dc0777d24ef49eb3576da32d1302 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,607 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e54d0d01bc3b46feb53bc61f55d6d183 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,607 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,607 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink df3416924e724009ad67006102ffbeec from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,618 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,619 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 096aff7795984b7aa5af978c982cd711 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 505c138cee9ef6b3bf2af1613b430403, disabling compactions & flushes 2023-02-17 22:01:07,620 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:07,620 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:07,620 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. after waiting 0 ms 2023-02-17 22:01:07,620 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:07,620 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:07,620 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:07,620 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4601b8c33a946bf746ac1245a8a112f0, NAME => 'testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0937af50422382f74d368592fe0b5cd6, disabling compactions & flushes 2023-02-17 22:01:07,622 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:07,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:07,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. after waiting 0 ms 2023-02-17 22:01:07,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:07,622 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:07,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:07,623 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 147da3b7bc4c9f656b0d17dbe4da4f7a, NAME => 'testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:07,627 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 7337cfaa770067dbc7df44ebdfff7069, disabling compactions & flushes 2023-02-17 22:01:07,627 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:07,627 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:07,627 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. after waiting 0 ms 2023-02-17 22:01:07,627 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:07,627 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:07,627 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:07,635 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5e3dd9101cf2482ea8b87dfb35e17223 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,636 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,636 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c09f94ed551445a89d800a7a248fb47 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,641 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02bba417285f4b2db6e92077a09318e8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,647 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,648 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af73bdb49462418291d3ae08f1c5b33f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,655 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,655 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink be3bf56484c141f6a6ab992b484ad796 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 1d2f1305f30ba046ad3393e66fd54326, disabling compactions & flushes 2023-02-17 22:01:07,656 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 000f98e14b87a35d74cccef96eb5d4bb, disabling compactions & flushes 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:07,656 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. after waiting 0 ms 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. after waiting 0 ms 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:07,656 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:07,656 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:07,656 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:07,657 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:07,657 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 49e9da09cae7437c94c159b919a3baa7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,657 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3a8127ba80614a66a47e2753d4f13c20 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,659 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink decde84c1d074489ab112214e51e6c04 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:07,660 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a1b468cb960424886748b60a1c723fc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e8a6a2ecf5feffda56c1e09b06327a85, disabling compactions & flushes 2023-02-17 22:01:07,661 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:07,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:07,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. after waiting 0 ms 2023-02-17 22:01:07,661 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 1c6eb348c1685ba893d7e098594b6a96, disabling compactions & flushes 2023-02-17 22:01:07,661 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:07,661 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:07,661 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:07,661 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. after waiting 0 ms 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:07,662 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 147da3b7bc4c9f656b0d17dbe4da4f7a, disabling compactions & flushes 2023-02-17 22:01:07,662 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. after waiting 0 ms 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:07,662 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:07,662 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:07,663 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2cddabef8bad46e0a2f57a5a20bec307 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:07,665 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4601b8c33a946bf746ac1245a8a112f0, disabling compactions & flushes 2023-02-17 22:01:07,665 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:07,665 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:07,665 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. after waiting 0 ms 2023-02-17 22:01:07,665 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:07,665 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:07,665 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:08,042 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:08,042 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3dac1b2185324f14859f2966aa4dbfce from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:08,045 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e7eae850b37472284ae1014ca6ba554 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 22:01:08,048 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d701324d21e25a61c50e3e2d6bfdc5f6, disabling compactions & flushes 2023-02-17 22:01:08,048 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:08,048 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:08,048 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. after waiting 0 ms 2023-02-17 22:01:08,048 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:08,048 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:08,048 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:08,048 INFO [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676671264194 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:08,049 DEBUG [Listener at localhost/34531] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:08,049 DEBUG [Listener at localhost/34531] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963 2023-02-17 22:01:08,050 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:08,050 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:08,051 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 22:01:08,051 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------000f98e14b87a35d74cccef96eb5d4bb/ 2023-02-17 22:01:08,052 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,052 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,053 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=000f98e14b87a35d74cccef96eb5d4bb-df3416924e724009ad67006102ffbeec 2023-02-17 22:01:08,053 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,054 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=000f98e14b87a35d74cccef96eb5d4bb-02bba417285f4b2db6e92077a09318e8 2023-02-17 22:01:08,054 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------0937af50422382f74d368592fe0b5cd6/ 2023-02-17 22:01:08,055 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,055 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------147da3b7bc4c9f656b0d17dbe4da4f7a/ 2023-02-17 22:01:08,055 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,055 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,056 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=147da3b7bc4c9f656b0d17dbe4da4f7a-be3bf56484c141f6a6ab992b484ad796 2023-02-17 22:01:08,056 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,057 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=147da3b7bc4c9f656b0d17dbe4da4f7a-decde84c1d074489ab112214e51e6c04 2023-02-17 22:01:08,057 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------1c6eb348c1685ba893d7e098594b6a96/ 2023-02-17 22:01:08,057 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,057 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,058 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=1c6eb348c1685ba893d7e098594b6a96-8c09f94ed551445a89d800a7a248fb47 2023-02-17 22:01:08,058 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,058 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=1c6eb348c1685ba893d7e098594b6a96-3a8127ba80614a66a47e2753d4f13c20 2023-02-17 22:01:08,059 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------1d2f1305f30ba046ad3393e66fd54326/ 2023-02-17 22:01:08,059 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,059 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,060 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=1d2f1305f30ba046ad3393e66fd54326-096aff7795984b7aa5af978c982cd711 2023-02-17 22:01:08,060 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,060 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=1d2f1305f30ba046ad3393e66fd54326-5e3dd9101cf2482ea8b87dfb35e17223 2023-02-17 22:01:08,060 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------4601b8c33a946bf746ac1245a8a112f0/ 2023-02-17 22:01:08,061 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,061 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,061 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=4601b8c33a946bf746ac1245a8a112f0-5a1b468cb960424886748b60a1c723fc 2023-02-17 22:01:08,061 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,062 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=4601b8c33a946bf746ac1245a8a112f0-2cddabef8bad46e0a2f57a5a20bec307 2023-02-17 22:01:08,062 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------505c138cee9ef6b3bf2af1613b430403/ 2023-02-17 22:01:08,062 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,062 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------7337cfaa770067dbc7df44ebdfff7069/ 2023-02-17 22:01:08,063 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,063 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,063 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=7337cfaa770067dbc7df44ebdfff7069-0d48dc0777d24ef49eb3576da32d1302 2023-02-17 22:01:08,063 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,064 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=7337cfaa770067dbc7df44ebdfff7069-e54d0d01bc3b46feb53bc61f55d6d183 2023-02-17 22:01:08,064 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------d701324d21e25a61c50e3e2d6bfdc5f6/ 2023-02-17 22:01:08,064 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,065 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,065 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=d701324d21e25a61c50e3e2d6bfdc5f6-3dac1b2185324f14859f2966aa4dbfce 2023-02-17 22:01:08,065 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,065 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=d701324d21e25a61c50e3e2d6bfdc5f6-9e7eae850b37472284ae1014ca6ba554 2023-02-17 22:01:08,065 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |----------e8a6a2ecf5feffda56c1e09b06327a85/ 2023-02-17 22:01:08,066 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:08,066 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:08,066 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=e8a6a2ecf5feffda56c1e09b06327a85-af73bdb49462418291d3ae08f1c5b33f 2023-02-17 22:01:08,066 DEBUG [Listener at localhost/34531] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:08,067 DEBUG [Listener at localhost/34531] util.CommonFSUtils(702): |----------------testWithMapReduce=e8a6a2ecf5feffda56c1e09b06327a85-49e9da09cae7437c94c159b919a3baa7 2023-02-17 22:01:08,075 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:08,075 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:08,076 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:08,076 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:08,365 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:08,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-17 22:01:08,960 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop-8623521916133336010.jar 2023-02-17 22:01:08,960 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:08,961 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,032 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop-8287490221946522405.jar 2023-02-17 22:01:09,032 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,033 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,033 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,034 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,034 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,035 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,035 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 22:01:09,036 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 22:01:09,036 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 22:01:09,037 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 22:01:09,037 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 22:01:09,038 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 22:01:09,039 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 22:01:09,039 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 22:01:09,040 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 22:01:09,041 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 22:01:09,046 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:09,047 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:09,048 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:09,048 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:09,048 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 22:01:09,120 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop-6778562432868952002.jar 2023-02-17 22:01:09,121 DEBUG [Listener at localhost/34531] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 22:01:09,171 WARN [Listener at localhost/34531] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 22:01:09,184 WARN [Listener at localhost/34531] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-17 22:01:09,197 INFO [Listener at localhost/34531] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 22:01:09,572 WARN [Listener at localhost/34531] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/mapreduce.cluster.local.dir/1676671269495/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 22:01:09,572 WARN [Listener at localhost/34531] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/mapreduce.cluster.local.dir/1676671269495/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 22:01:09,757 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:09,757 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:09,767 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:09,770 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:09,771 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1 2023-02-17 22:01:09,772 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 000f98e14b87a35d74cccef96eb5d4bb columnFamilyName f1 2023-02-17 22:01:09,782 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/testWithMapReduce=000f98e14b87a35d74cccef96eb5d4bb-df3416924e724009ad67006102ffbeec 2023-02-17 22:01:09,783 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(310): Store=000f98e14b87a35d74cccef96eb5d4bb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:09,783 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:09,784 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2 2023-02-17 22:01:09,784 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 000f98e14b87a35d74cccef96eb5d4bb columnFamilyName f2 2023-02-17 22:01:09,791 DEBUG [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/testWithMapReduce=000f98e14b87a35d74cccef96eb5d4bb-02bba417285f4b2db6e92077a09318e8 2023-02-17 22:01:09,791 INFO [StoreOpener-000f98e14b87a35d74cccef96eb5d4bb-1] regionserver.HStore(310): Store=000f98e14b87a35d74cccef96eb5d4bb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:09,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:09,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 000f98e14b87a35d74cccef96eb5d4bb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71113364, jitterRate=0.05967170000076294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:09,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:09,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 000f98e14b87a35d74cccef96eb5d4bb, disabling compactions & flushes 2023-02-17 22:01:09,961 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:09,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:09,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. after waiting 0 ms 2023-02-17 22:01:09,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:09,966 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:09,966 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:09,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:09,982 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:09,983 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:09,985 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:09,987 DEBUG [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f1 2023-02-17 22:01:09,988 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0937af50422382f74d368592fe0b5cd6 columnFamilyName f1 2023-02-17 22:01:09,988 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(310): Store=0937af50422382f74d368592fe0b5cd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:09,989 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:09,990 DEBUG [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f2 2023-02-17 22:01:09,991 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0937af50422382f74d368592fe0b5cd6 columnFamilyName f2 2023-02-17 22:01:09,992 INFO [StoreOpener-0937af50422382f74d368592fe0b5cd6-1] regionserver.HStore(310): Store=0937af50422382f74d368592fe0b5cd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:09,993 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:09,993 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0937af50422382f74d368592fe0b5cd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69056031, jitterRate=0.02901504933834076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:09,993 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:10,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0937af50422382f74d368592fe0b5cd6, disabling compactions & flushes 2023-02-17 22:01:10,052 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:10,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:10,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. after waiting 0 ms 2023-02-17 22:01:10,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:10,053 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:10,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:10,059 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,059 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,060 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,063 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:10,064 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1 2023-02-17 22:01:10,064 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 147da3b7bc4c9f656b0d17dbe4da4f7a columnFamilyName f1 2023-02-17 22:01:10,072 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/testWithMapReduce=147da3b7bc4c9f656b0d17dbe4da4f7a-be3bf56484c141f6a6ab992b484ad796 2023-02-17 22:01:10,072 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(310): Store=147da3b7bc4c9f656b0d17dbe4da4f7a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,072 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:10,073 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2 2023-02-17 22:01:10,074 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 147da3b7bc4c9f656b0d17dbe4da4f7a columnFamilyName f2 2023-02-17 22:01:10,097 DEBUG [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/testWithMapReduce=147da3b7bc4c9f656b0d17dbe4da4f7a-decde84c1d074489ab112214e51e6c04 2023-02-17 22:01:10,097 INFO [StoreOpener-147da3b7bc4c9f656b0d17dbe4da4f7a-1] regionserver.HStore(310): Store=147da3b7bc4c9f656b0d17dbe4da4f7a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,098 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 147da3b7bc4c9f656b0d17dbe4da4f7a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67842596, jitterRate=0.010933458805084229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:10,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 147da3b7bc4c9f656b0d17dbe4da4f7a, disabling compactions & flushes 2023-02-17 22:01:10,142 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:10,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:10,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. after waiting 0 ms 2023-02-17 22:01:10,143 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:10,150 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:10,150 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:10,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,177 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,195 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,199 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:10,201 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1 2023-02-17 22:01:10,201 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2f1305f30ba046ad3393e66fd54326 columnFamilyName f1 2023-02-17 22:01:10,209 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/testWithMapReduce=1d2f1305f30ba046ad3393e66fd54326-096aff7795984b7aa5af978c982cd711 2023-02-17 22:01:10,209 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(310): Store=1d2f1305f30ba046ad3393e66fd54326/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,210 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:10,211 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2 2023-02-17 22:01:10,211 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2f1305f30ba046ad3393e66fd54326 columnFamilyName f2 2023-02-17 22:01:10,218 DEBUG [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/testWithMapReduce=1d2f1305f30ba046ad3393e66fd54326-5e3dd9101cf2482ea8b87dfb35e17223 2023-02-17 22:01:10,219 INFO [StoreOpener-1d2f1305f30ba046ad3393e66fd54326-1] regionserver.HStore(310): Store=1d2f1305f30ba046ad3393e66fd54326/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,219 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1d2f1305f30ba046ad3393e66fd54326; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67310293, jitterRate=0.0030015259981155396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:10,272 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1d2f1305f30ba046ad3393e66fd54326, disabling compactions & flushes 2023-02-17 22:01:10,272 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:10,272 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:10,272 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. after waiting 0 ms 2023-02-17 22:01:10,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:10,285 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:10,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:10,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,293 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,299 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,303 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:10,305 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1 2023-02-17 22:01:10,305 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6eb348c1685ba893d7e098594b6a96 columnFamilyName f1 2023-02-17 22:01:10,313 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/testWithMapReduce=1c6eb348c1685ba893d7e098594b6a96-8c09f94ed551445a89d800a7a248fb47 2023-02-17 22:01:10,313 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(310): Store=1c6eb348c1685ba893d7e098594b6a96/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,313 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:10,315 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2 2023-02-17 22:01:10,315 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6eb348c1685ba893d7e098594b6a96 columnFamilyName f2 2023-02-17 22:01:10,323 DEBUG [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/testWithMapReduce=1c6eb348c1685ba893d7e098594b6a96-3a8127ba80614a66a47e2753d4f13c20 2023-02-17 22:01:10,323 INFO [StoreOpener-1c6eb348c1685ba893d7e098594b6a96-1] regionserver.HStore(310): Store=1c6eb348c1685ba893d7e098594b6a96/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,324 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1c6eb348c1685ba893d7e098594b6a96; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59241128, jitterRate=-0.11723840236663818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:10,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1c6eb348c1685ba893d7e098594b6a96, disabling compactions & flushes 2023-02-17 22:01:10,375 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:10,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:10,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. after waiting 0 ms 2023-02-17 22:01:10,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:10,378 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:10,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:10,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,384 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,385 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,387 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:10,388 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1 2023-02-17 22:01:10,389 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4601b8c33a946bf746ac1245a8a112f0 columnFamilyName f1 2023-02-17 22:01:10,396 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/testWithMapReduce=4601b8c33a946bf746ac1245a8a112f0-5a1b468cb960424886748b60a1c723fc 2023-02-17 22:01:10,396 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(310): Store=4601b8c33a946bf746ac1245a8a112f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,396 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:10,397 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2 2023-02-17 22:01:10,397 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4601b8c33a946bf746ac1245a8a112f0 columnFamilyName f2 2023-02-17 22:01:10,408 DEBUG [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/testWithMapReduce=4601b8c33a946bf746ac1245a8a112f0-2cddabef8bad46e0a2f57a5a20bec307 2023-02-17 22:01:10,409 INFO [StoreOpener-4601b8c33a946bf746ac1245a8a112f0-1] regionserver.HStore(310): Store=4601b8c33a946bf746ac1245a8a112f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,409 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4601b8c33a946bf746ac1245a8a112f0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70021126, jitterRate=0.04339608550071716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:10,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4601b8c33a946bf746ac1245a8a112f0, disabling compactions & flushes 2023-02-17 22:01:10,486 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:10,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:10,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. after waiting 0 ms 2023-02-17 22:01:10,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:10,490 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:10,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:10,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,495 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,503 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,506 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:10,507 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1 2023-02-17 22:01:10,508 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d701324d21e25a61c50e3e2d6bfdc5f6 columnFamilyName f1 2023-02-17 22:01:10,515 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/testWithMapReduce=d701324d21e25a61c50e3e2d6bfdc5f6-3dac1b2185324f14859f2966aa4dbfce 2023-02-17 22:01:10,515 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(310): Store=d701324d21e25a61c50e3e2d6bfdc5f6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,515 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:10,516 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2 2023-02-17 22:01:10,517 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d701324d21e25a61c50e3e2d6bfdc5f6 columnFamilyName f2 2023-02-17 22:01:10,525 DEBUG [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/testWithMapReduce=d701324d21e25a61c50e3e2d6bfdc5f6-9e7eae850b37472284ae1014ca6ba554 2023-02-17 22:01:10,525 INFO [StoreOpener-d701324d21e25a61c50e3e2d6bfdc5f6-1] regionserver.HStore(310): Store=d701324d21e25a61c50e3e2d6bfdc5f6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,525 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,525 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d701324d21e25a61c50e3e2d6bfdc5f6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69345920, jitterRate=0.03333473205566406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,525 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:10,570 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d701324d21e25a61c50e3e2d6bfdc5f6, disabling compactions & flushes 2023-02-17 22:01:10,570 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:10,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:10,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. after waiting 0 ms 2023-02-17 22:01:10,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:10,574 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:10,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:10,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,579 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,584 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,587 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:10,589 DEBUG [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f1 2023-02-17 22:01:10,590 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 505c138cee9ef6b3bf2af1613b430403 columnFamilyName f1 2023-02-17 22:01:10,591 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(310): Store=505c138cee9ef6b3bf2af1613b430403/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,591 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:10,593 DEBUG [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f2 2023-02-17 22:01:10,593 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 505c138cee9ef6b3bf2af1613b430403 columnFamilyName f2 2023-02-17 22:01:10,594 INFO [StoreOpener-505c138cee9ef6b3bf2af1613b430403-1] regionserver.HStore(310): Store=505c138cee9ef6b3bf2af1613b430403/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,594 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 505c138cee9ef6b3bf2af1613b430403; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71110553, jitterRate=0.059629812836647034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,594 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:10,616 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 505c138cee9ef6b3bf2af1613b430403, disabling compactions & flushes 2023-02-17 22:01:10,616 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:10,616 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:10,616 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. after waiting 0 ms 2023-02-17 22:01:10,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:10,617 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:10,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:10,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,623 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,633 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,638 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:10,640 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1 2023-02-17 22:01:10,640 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a6a2ecf5feffda56c1e09b06327a85 columnFamilyName f1 2023-02-17 22:01:10,652 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/testWithMapReduce=e8a6a2ecf5feffda56c1e09b06327a85-af73bdb49462418291d3ae08f1c5b33f 2023-02-17 22:01:10,653 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(310): Store=e8a6a2ecf5feffda56c1e09b06327a85/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,653 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:10,655 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2 2023-02-17 22:01:10,655 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8a6a2ecf5feffda56c1e09b06327a85 columnFamilyName f2 2023-02-17 22:01:10,661 DEBUG [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/testWithMapReduce=e8a6a2ecf5feffda56c1e09b06327a85-49e9da09cae7437c94c159b919a3baa7 2023-02-17 22:01:10,661 INFO [StoreOpener-e8a6a2ecf5feffda56c1e09b06327a85-1] regionserver.HStore(310): Store=e8a6a2ecf5feffda56c1e09b06327a85/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,662 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e8a6a2ecf5feffda56c1e09b06327a85; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75247585, jitterRate=0.12127639353275299}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:10,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e8a6a2ecf5feffda56c1e09b06327a85, disabling compactions & flushes 2023-02-17 22:01:10,695 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:10,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:10,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. after waiting 0 ms 2023-02-17 22:01:10,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:10,700 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:10,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:10,704 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:10,704 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:10,713 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:10,717 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:10,718 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1 2023-02-17 22:01:10,719 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7337cfaa770067dbc7df44ebdfff7069 columnFamilyName f1 2023-02-17 22:01:10,725 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/testWithMapReduce=7337cfaa770067dbc7df44ebdfff7069-0d48dc0777d24ef49eb3576da32d1302 2023-02-17 22:01:10,725 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(310): Store=7337cfaa770067dbc7df44ebdfff7069/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,725 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:10,726 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2 2023-02-17 22:01:10,727 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7337cfaa770067dbc7df44ebdfff7069 columnFamilyName f2 2023-02-17 22:01:10,733 DEBUG [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/79ffb509-e55c-ddd1-54ca-546b3b1bbb0c/testWithMapReduceMultiRegion/27b751a7-6209-44a5-96d5-77a7baf8c963/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/testWithMapReduce=7337cfaa770067dbc7df44ebdfff7069-e54d0d01bc3b46feb53bc61f55d6d183 2023-02-17 22:01:10,733 INFO [StoreOpener-7337cfaa770067dbc7df44ebdfff7069-1] regionserver.HStore(310): Store=7337cfaa770067dbc7df44ebdfff7069/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:10,733 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:10,733 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7337cfaa770067dbc7df44ebdfff7069; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58788029, jitterRate=-0.12399010360240936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:10,733 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:10,787 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7337cfaa770067dbc7df44ebdfff7069, disabling compactions & flushes 2023-02-17 22:01:10,787 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:10,787 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:10,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. after waiting 0 ms 2023-02-17 22:01:10,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:10,790 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:10,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:11,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMapReduceMultiRegion" 2023-02-17 22:01:11,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-17 22:01:11,667 INFO [Listener at localhost/34531] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 22:01:11,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-17 22:01:11,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-17 22:01:11,679 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671271679"}]},"ts":"1676671271679"} 2023-02-17 22:01:11,681 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-17 22:01:11,683 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-17 22:01:11,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:11,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, UNASSIGN}] 2023-02-17 22:01:11,692 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, UNASSIGN 2023-02-17 22:01:11,692 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, UNASSIGN 2023-02-17 22:01:11,693 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, UNASSIGN 2023-02-17 22:01:11,693 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, UNASSIGN 2023-02-17 22:01:11,693 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, UNASSIGN 2023-02-17 22:01:11,694 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=000f98e14b87a35d74cccef96eb5d4bb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:11,694 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271694"}]},"ts":"1676671271694"} 2023-02-17 22:01:11,694 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=147da3b7bc4c9f656b0d17dbe4da4f7a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:11,694 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=1d2f1305f30ba046ad3393e66fd54326, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:11,695 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271694"}]},"ts":"1676671271694"} 2023-02-17 22:01:11,695 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271694"}]},"ts":"1676671271694"} 2023-02-17 22:01:11,695 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e8a6a2ecf5feffda56c1e09b06327a85, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:11,695 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271695"}]},"ts":"1676671271695"} 2023-02-17 22:01:11,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=505c138cee9ef6b3bf2af1613b430403, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:11,696 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671271695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271695"}]},"ts":"1676671271695"} 2023-02-17 22:01:11,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=41, state=RUNNABLE; CloseRegionProcedure 000f98e14b87a35d74cccef96eb5d4bb, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:11,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure 147da3b7bc4c9f656b0d17dbe4da4f7a, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:11,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 1d2f1305f30ba046ad3393e66fd54326, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:11,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure e8a6a2ecf5feffda56c1e09b06327a85, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:11,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 505c138cee9ef6b3bf2af1613b430403, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:11,715 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, UNASSIGN 2023-02-17 22:01:11,715 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, UNASSIGN 2023-02-17 22:01:11,715 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, UNASSIGN 2023-02-17 22:01:11,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, UNASSIGN 2023-02-17 22:01:11,717 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7337cfaa770067dbc7df44ebdfff7069, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:11,717 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271717"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271717"}]},"ts":"1676671271717"} 2023-02-17 22:01:11,718 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, UNASSIGN 2023-02-17 22:01:11,718 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1c6eb348c1685ba893d7e098594b6a96, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:11,718 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271718"}]},"ts":"1676671271718"} 2023-02-17 22:01:11,718 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4601b8c33a946bf746ac1245a8a112f0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:11,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271718"}]},"ts":"1676671271718"} 2023-02-17 22:01:11,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d701324d21e25a61c50e3e2d6bfdc5f6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:11,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271718"}]},"ts":"1676671271718"} 2023-02-17 22:01:11,720 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=0937af50422382f74d368592fe0b5cd6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:11,720 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671271720"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671271720"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671271720"}]},"ts":"1676671271720"} 2023-02-17 22:01:11,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 7337cfaa770067dbc7df44ebdfff7069, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:11,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=36, state=RUNNABLE; CloseRegionProcedure 1c6eb348c1685ba893d7e098594b6a96, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:11,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=37, state=RUNNABLE; CloseRegionProcedure 4601b8c33a946bf746ac1245a8a112f0, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:11,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure d701324d21e25a61c50e3e2d6bfdc5f6, server=jenkins-hbase9.apache.org,36361,1676671259402}] 2023-02-17 22:01:11,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 0937af50422382f74d368592fe0b5cd6, server=jenkins-hbase9.apache.org,45019,1676671259449}] 2023-02-17 22:01:11,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:11,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:11,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:11,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1d2f1305f30ba046ad3393e66fd54326, disabling compactions & flushes 2023-02-17 22:01:11,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7337cfaa770067dbc7df44ebdfff7069, disabling compactions & flushes 2023-02-17 22:01:11,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:11,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:11,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:11,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:11,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. after waiting 0 ms 2023-02-17 22:01:11,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:11,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. after waiting 0 ms 2023-02-17 22:01:11,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:11,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326. 2023-02-17 22:01:11,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1d2f1305f30ba046ad3393e66fd54326: 2023-02-17 22:01:11,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069. 2023-02-17 22:01:11,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7337cfaa770067dbc7df44ebdfff7069: 2023-02-17 22:01:11,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:11,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:11,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 000f98e14b87a35d74cccef96eb5d4bb, disabling compactions & flushes 2023-02-17 22:01:11,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:11,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:11,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. after waiting 0 ms 2023-02-17 22:01:11,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:11,891 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=1d2f1305f30ba046ad3393e66fd54326, regionState=CLOSED 2023-02-17 22:01:11,891 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271891"}]},"ts":"1676671271891"} 2023-02-17 22:01:11,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:11,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:11,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1c6eb348c1685ba893d7e098594b6a96, disabling compactions & flushes 2023-02-17 22:01:11,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:11,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:11,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. after waiting 0 ms 2023-02-17 22:01:11,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:11,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7337cfaa770067dbc7df44ebdfff7069, regionState=CLOSED 2023-02-17 22:01:11,892 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271892"}]},"ts":"1676671271892"} 2023-02-17 22:01:11,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-17 22:01:11,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 1d2f1305f30ba046ad3393e66fd54326, server=jenkins-hbase9.apache.org,45019,1676671259449 in 189 msec 2023-02-17 22:01:11,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-17 22:01:11,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1d2f1305f30ba046ad3393e66fd54326, UNASSIGN in 217 msec 2023-02-17 22:01:11,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 7337cfaa770067dbc7df44ebdfff7069, server=jenkins-hbase9.apache.org,36361,1676671259402 in 174 msec 2023-02-17 22:01:11,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96. 2023-02-17 22:01:11,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1c6eb348c1685ba893d7e098594b6a96: 2023-02-17 22:01:11,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7337cfaa770067dbc7df44ebdfff7069, UNASSIGN in 218 msec 2023-02-17 22:01:11,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:11,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:11,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e8a6a2ecf5feffda56c1e09b06327a85, disabling compactions & flushes 2023-02-17 22:01:11,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:11,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:11,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. after waiting 0 ms 2023-02-17 22:01:11,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:11,919 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1c6eb348c1685ba893d7e098594b6a96, regionState=CLOSED 2023-02-17 22:01:11,919 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271919"}]},"ts":"1676671271919"} 2023-02-17 22:01:11,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=36 2023-02-17 22:01:11,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=36, state=SUCCESS; CloseRegionProcedure 1c6eb348c1685ba893d7e098594b6a96, server=jenkins-hbase9.apache.org,36361,1676671259402 in 198 msec 2023-02-17 22:01:11,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1c6eb348c1685ba893d7e098594b6a96, UNASSIGN in 236 msec 2023-02-17 22:01:11,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb. 2023-02-17 22:01:11,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 000f98e14b87a35d74cccef96eb5d4bb: 2023-02-17 22:01:11,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:11,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:11,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 505c138cee9ef6b3bf2af1613b430403, disabling compactions & flushes 2023-02-17 22:01:11,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:11,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:11,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. after waiting 0 ms 2023-02-17 22:01:11,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:11,933 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=000f98e14b87a35d74cccef96eb5d4bb, regionState=CLOSED 2023-02-17 22:01:11,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271933"}]},"ts":"1676671271933"} 2023-02-17 22:01:11,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85. 2023-02-17 22:01:11,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e8a6a2ecf5feffda56c1e09b06327a85: 2023-02-17 22:01:11,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 22:01:11,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=41 2023-02-17 22:01:11,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=41, state=SUCCESS; CloseRegionProcedure 000f98e14b87a35d74cccef96eb5d4bb, server=jenkins-hbase9.apache.org,45019,1676671259449 in 238 msec 2023-02-17 22:01:11,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403. 2023-02-17 22:01:11,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 505c138cee9ef6b3bf2af1613b430403: 2023-02-17 22:01:11,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:11,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:11,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d701324d21e25a61c50e3e2d6bfdc5f6, disabling compactions & flushes 2023-02-17 22:01:11,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:11,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:11,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. after waiting 0 ms 2023-02-17 22:01:11,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:11,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e8a6a2ecf5feffda56c1e09b06327a85, regionState=CLOSED 2023-02-17 22:01:11,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271940"}]},"ts":"1676671271940"} 2023-02-17 22:01:11,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=000f98e14b87a35d74cccef96eb5d4bb, UNASSIGN in 252 msec 2023-02-17 22:01:11,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:11,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:11,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 0937af50422382f74d368592fe0b5cd6, disabling compactions & flushes 2023-02-17 22:01:11,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:11,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:11,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. after waiting 0 ms 2023-02-17 22:01:11,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:11,943 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=505c138cee9ef6b3bf2af1613b430403, regionState=CLOSED 2023-02-17 22:01:11,943 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671271943"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271943"}]},"ts":"1676671271943"} 2023-02-17 22:01:11,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-17 22:01:11,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure e8a6a2ecf5feffda56c1e09b06327a85, server=jenkins-hbase9.apache.org,36361,1676671259402 in 235 msec 2023-02-17 22:01:11,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6. 2023-02-17 22:01:11,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d701324d21e25a61c50e3e2d6bfdc5f6: 2023-02-17 22:01:11,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e8a6a2ecf5feffda56c1e09b06327a85, UNASSIGN in 259 msec 2023-02-17 22:01:11,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 22:01:11,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:11,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:11,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 147da3b7bc4c9f656b0d17dbe4da4f7a, disabling compactions & flushes 2023-02-17 22:01:11,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:11,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:11,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. after waiting 0 ms 2023-02-17 22:01:11,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:11,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-17 22:01:11,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d701324d21e25a61c50e3e2d6bfdc5f6, regionState=CLOSED 2023-02-17 22:01:11,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 505c138cee9ef6b3bf2af1613b430403, server=jenkins-hbase9.apache.org,45019,1676671259449 in 237 msec 2023-02-17 22:01:11,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6. 2023-02-17 22:01:11,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 0937af50422382f74d368592fe0b5cd6: 2023-02-17 22:01:11,952 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271951"}]},"ts":"1676671271951"} 2023-02-17 22:01:11,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:11,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:11,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 4601b8c33a946bf746ac1245a8a112f0, disabling compactions & flushes 2023-02-17 22:01:11,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:11,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:11,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. after waiting 0 ms 2023-02-17 22:01:11,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:11,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=505c138cee9ef6b3bf2af1613b430403, UNASSIGN in 263 msec 2023-02-17 22:01:11,956 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=0937af50422382f74d368592fe0b5cd6, regionState=CLOSED 2023-02-17 22:01:11,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671271956"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271956"}]},"ts":"1676671271956"} 2023-02-17 22:01:11,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-17 22:01:11,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure d701324d21e25a61c50e3e2d6bfdc5f6, server=jenkins-hbase9.apache.org,36361,1676671259402 in 229 msec 2023-02-17 22:01:11,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d701324d21e25a61c50e3e2d6bfdc5f6, UNASSIGN in 271 msec 2023-02-17 22:01:11,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a. 2023-02-17 22:01:11,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 147da3b7bc4c9f656b0d17dbe4da4f7a: 2023-02-17 22:01:11,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-17 22:01:11,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 0937af50422382f74d368592fe0b5cd6, server=jenkins-hbase9.apache.org,45019,1676671259449 in 229 msec 2023-02-17 22:01:11,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0937af50422382f74d368592fe0b5cd6, UNASSIGN in 285 msec 2023-02-17 22:01:11,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:11,975 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=147da3b7bc4c9f656b0d17dbe4da4f7a, regionState=CLOSED 2023-02-17 22:01:11,975 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271975"}]},"ts":"1676671271975"} 2023-02-17 22:01:11,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:11,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0. 2023-02-17 22:01:11,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 4601b8c33a946bf746ac1245a8a112f0: 2023-02-17 22:01:11,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:11,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-17 22:01:11,980 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4601b8c33a946bf746ac1245a8a112f0, regionState=CLOSED 2023-02-17 22:01:11,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure 147da3b7bc4c9f656b0d17dbe4da4f7a, server=jenkins-hbase9.apache.org,36361,1676671259402 in 273 msec 2023-02-17 22:01:11,980 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671271980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671271980"}]},"ts":"1676671271980"} 2023-02-17 22:01:11,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=147da3b7bc4c9f656b0d17dbe4da4f7a, UNASSIGN in 293 msec 2023-02-17 22:01:11,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=37 2023-02-17 22:01:11,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=37, state=SUCCESS; CloseRegionProcedure 4601b8c33a946bf746ac1245a8a112f0, server=jenkins-hbase9.apache.org,45019,1676671259449 in 258 msec 2023-02-17 22:01:11,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:11,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-17 22:01:11,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4601b8c33a946bf746ac1245a8a112f0, UNASSIGN in 298 msec 2023-02-17 22:01:11,989 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671271989"}]},"ts":"1676671271989"} 2023-02-17 22:01:11,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-17 22:01:11,997 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-17 22:01:11,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 330 msec 2023-02-17 22:01:12,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:12,290 INFO [Listener at localhost/34531] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-17 22:01:12,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testWithMapReduce 2023-02-17 22:01:12,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:12,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:12,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:12,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 22:01:12,318 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:12,318 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:12,318 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:12,319 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:12,319 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:12,318 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:12,318 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:12,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:12,324 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/recovered.edits] 2023-02-17 22:01:12,324 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/recovered.edits] 2023-02-17 22:01:12,326 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/recovered.edits] 2023-02-17 22:01:12,327 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/recovered.edits] 2023-02-17 22:01:12,328 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/recovered.edits] 2023-02-17 22:01:12,328 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/recovered.edits] 2023-02-17 22:01:12,331 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/recovered.edits] 2023-02-17 22:01:12,331 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/recovered.edits] 2023-02-17 22:01:12,340 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/0a2436f402134fff9e949a6f28237f62 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/0a2436f402134fff9e949a6f28237f62 2023-02-17 22:01:12,341 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/26792cb258cd484c9adea53fc02c9f05 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/26792cb258cd484c9adea53fc02c9f05 2023-02-17 22:01:12,341 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/096aff7795984b7aa5af978c982cd711 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/096aff7795984b7aa5af978c982cd711 2023-02-17 22:01:12,341 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/3dac1b2185324f14859f2966aa4dbfce to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/3dac1b2185324f14859f2966aa4dbfce 2023-02-17 22:01:12,343 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/05c1f83228ec430f842a54dff955a949 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/05c1f83228ec430f842a54dff955a949 2023-02-17 22:01:12,343 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/bd1479e67a974f9584c0c7bb0a208a58 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f1/bd1479e67a974f9584c0c7bb0a208a58 2023-02-17 22:01:12,347 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/af73bdb49462418291d3ae08f1c5b33f to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/af73bdb49462418291d3ae08f1c5b33f 2023-02-17 22:01:12,347 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/df3416924e724009ad67006102ffbeec to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f1/df3416924e724009ad67006102ffbeec 2023-02-17 22:01:12,347 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/5a1b468cb960424886748b60a1c723fc to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f1/5a1b468cb960424886748b60a1c723fc 2023-02-17 22:01:12,347 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/8c09f94ed551445a89d800a7a248fb47 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/8c09f94ed551445a89d800a7a248fb47 2023-02-17 22:01:12,348 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/recovered.edits/6.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6/recovered.edits/6.seqid 2023-02-17 22:01:12,350 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/0937af50422382f74d368592fe0b5cd6 2023-02-17 22:01:12,350 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:12,350 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/d71a855c3a42441190af3d55940af273 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f1/d71a855c3a42441190af3d55940af273 2023-02-17 22:01:12,351 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/be3bf56484c141f6a6ab992b484ad796 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f1/be3bf56484c141f6a6ab992b484ad796 2023-02-17 22:01:12,353 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/c19079d437424522b1cfe0271c388dba to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f1/c19079d437424522b1cfe0271c388dba 2023-02-17 22:01:12,353 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/b1ed986ed4794e9791bc09a19f6f862f to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f1/b1ed986ed4794e9791bc09a19f6f862f 2023-02-17 22:01:12,358 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/2c841772b83c45e6bb82e0d4a142a6d5 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/2c841772b83c45e6bb82e0d4a142a6d5 2023-02-17 22:01:12,358 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/2cddabef8bad46e0a2f57a5a20bec307 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/2cddabef8bad46e0a2f57a5a20bec307 2023-02-17 22:01:12,359 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/recovered.edits] 2023-02-17 22:01:12,363 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/02bba417285f4b2db6e92077a09318e8 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/02bba417285f4b2db6e92077a09318e8 2023-02-17 22:01:12,368 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/6fe7d1f56e2b4d6bad672818e0fb9dc2 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/6fe7d1f56e2b4d6bad672818e0fb9dc2 2023-02-17 22:01:12,368 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/5e3dd9101cf2482ea8b87dfb35e17223 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/f2/5e3dd9101cf2482ea8b87dfb35e17223 2023-02-17 22:01:12,369 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/759bdf726b0845338d01fa27f62b7a87 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/759bdf726b0845338d01fa27f62b7a87 2023-02-17 22:01:12,370 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/6e788ea36761440e977d93d1a07f598c to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/f2/6e788ea36761440e977d93d1a07f598c 2023-02-17 22:01:12,370 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/3a8127ba80614a66a47e2753d4f13c20 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/3a8127ba80614a66a47e2753d4f13c20 2023-02-17 22:01:12,371 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/fc8e43bd3dca4c3f97862437af8bd172 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/f2/fc8e43bd3dca4c3f97862437af8bd172 2023-02-17 22:01:12,371 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/142e47598264453692be970713f2e0ed to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/142e47598264453692be970713f2e0ed 2023-02-17 22:01:12,373 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/9e7eae850b37472284ae1014ca6ba554 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/f2/9e7eae850b37472284ae1014ca6ba554 2023-02-17 22:01:12,375 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/decde84c1d074489ab112214e51e6c04 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/f2/decde84c1d074489ab112214e51e6c04 2023-02-17 22:01:12,375 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/49e9da09cae7437c94c159b919a3baa7 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/f2/49e9da09cae7437c94c159b919a3baa7 2023-02-17 22:01:12,375 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/cab4d0a6b6ab456cacc0ef39a0c6422c to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/f2/cab4d0a6b6ab456cacc0ef39a0c6422c 2023-02-17 22:01:12,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326/recovered.edits/12.seqid 2023-02-17 22:01:12,378 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/0d48dc0777d24ef49eb3576da32d1302 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/0d48dc0777d24ef49eb3576da32d1302 2023-02-17 22:01:12,380 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1d2f1305f30ba046ad3393e66fd54326 2023-02-17 22:01:12,380 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:12,381 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0/recovered.edits/12.seqid 2023-02-17 22:01:12,383 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/4601b8c33a946bf746ac1245a8a112f0 2023-02-17 22:01:12,383 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6/recovered.edits/12.seqid 2023-02-17 22:01:12,383 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb/recovered.edits/12.seqid 2023-02-17 22:01:12,384 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/45fbcbee894d4f949b8c6834cf51b43f to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f1/45fbcbee894d4f949b8c6834cf51b43f 2023-02-17 22:01:12,385 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/d701324d21e25a61c50e3e2d6bfdc5f6 2023-02-17 22:01:12,385 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/000f98e14b87a35d74cccef96eb5d4bb 2023-02-17 22:01:12,386 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/recovered.edits] 2023-02-17 22:01:12,386 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85/recovered.edits/12.seqid 2023-02-17 22:01:12,386 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a/recovered.edits/12.seqid 2023-02-17 22:01:12,386 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96/recovered.edits/12.seqid 2023-02-17 22:01:12,389 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/1c6eb348c1685ba893d7e098594b6a96 2023-02-17 22:01:12,389 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/e8a6a2ecf5feffda56c1e09b06327a85 2023-02-17 22:01:12,389 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/147da3b7bc4c9f656b0d17dbe4da4f7a 2023-02-17 22:01:12,392 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/c49a74e9ff2f4858a3852961b17e6548 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/c49a74e9ff2f4858a3852961b17e6548 2023-02-17 22:01:12,394 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/e54d0d01bc3b46feb53bc61f55d6d183 to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/f2/e54d0d01bc3b46feb53bc61f55d6d183 2023-02-17 22:01:12,397 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/recovered.edits/6.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403/recovered.edits/6.seqid 2023-02-17 22:01:12,399 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/505c138cee9ef6b3bf2af1613b430403 2023-02-17 22:01:12,399 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/archive/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069/recovered.edits/12.seqid 2023-02-17 22:01:12,400 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/.tmp/data/default/testWithMapReduce/7337cfaa770067dbc7df44ebdfff7069 2023-02-17 22:01:12,400 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 22:01:12,403 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:12,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 22:01:12,431 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-17 22:01:12,436 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-17 22:01:12,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:12,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-17 22:01:12,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671272440"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-17 22:01:12,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0937af50422382f74d368592fe0b5cd6, NAME => 'testWithMapReduce,,1676671262429.0937af50422382f74d368592fe0b5cd6.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => d701324d21e25a61c50e3e2d6bfdc5f6, NAME => 'testWithMapReduce,aaa,1676671262429.d701324d21e25a61c50e3e2d6bfdc5f6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 1c6eb348c1685ba893d7e098594b6a96, NAME => 'testWithMapReduce,d\x84\x84,1676671262429.1c6eb348c1685ba893d7e098594b6a96.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 4601b8c33a946bf746ac1245a8a112f0, NAME => 'testWithMapReduce,g\xA7\xA7,1676671262429.4601b8c33a946bf746ac1245a8a112f0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 147da3b7bc4c9f656b0d17dbe4da4f7a, NAME => 'testWithMapReduce,j\xCA\xCA,1676671262429.147da3b7bc4c9f656b0d17dbe4da4f7a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 1d2f1305f30ba046ad3393e66fd54326, NAME => 'testWithMapReduce,m\xED\xED,1676671262429.1d2f1305f30ba046ad3393e66fd54326.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => e8a6a2ecf5feffda56c1e09b06327a85, NAME => 'testWithMapReduce,q\x11\x10,1676671262429.e8a6a2ecf5feffda56c1e09b06327a85.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 000f98e14b87a35d74cccef96eb5d4bb, NAME => 'testWithMapReduce,t43,1676671262429.000f98e14b87a35d74cccef96eb5d4bb.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7337cfaa770067dbc7df44ebdfff7069, NAME => 'testWithMapReduce,wWV,1676671262429.7337cfaa770067dbc7df44ebdfff7069.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 505c138cee9ef6b3bf2af1613b430403, NAME => 'testWithMapReduce,zz{,1676671262429.505c138cee9ef6b3bf2af1613b430403.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-17 22:01:12,444 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-17 22:01:12,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676671272445"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:12,447 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-17 22:01:12,449 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:12,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 154 msec 2023-02-17 22:01:12,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41817] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 22:01:12,609 INFO [Listener at localhost/34531] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-17 22:01:12,609 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:12,609 INFO [Listener at localhost/34531] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:12,610 DEBUG [Listener at localhost/34531] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b04d0a2 to 127.0.0.1:52138 2023-02-17 22:01:12,610 DEBUG [Listener at localhost/34531] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:12,610 DEBUG [Listener at localhost/34531] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:12,610 DEBUG [Listener at localhost/34531] util.JVMClusterUtil(257): Found active master hash=1139294582, stopped=false 2023-02-17 22:01:12,610 INFO [Listener at localhost/34531] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:01:12,613 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:12,613 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:12,613 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:12,613 INFO [Listener at localhost/34531] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:12,613 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:12,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:12,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:12,623 DEBUG [Listener at localhost/34531] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x419a4e20 to 127.0.0.1:52138 2023-02-17 22:01:12,623 DEBUG [Listener at localhost/34531] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:12,623 INFO [Listener at localhost/34531] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,36361,1676671259402' ***** 2023-02-17 22:01:12,624 INFO [Listener at localhost/34531] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:12,624 INFO [Listener at localhost/34531] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45019,1676671259449' ***** 2023-02-17 22:01:12,624 INFO [Listener at localhost/34531] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:12,624 INFO [RS:1;jenkins-hbase9:45019] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:12,624 INFO [RS:1;jenkins-hbase9:45019] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:12,624 INFO [RS:0;jenkins-hbase9:36361] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:12,624 INFO [RS:1;jenkins-hbase9:45019] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:12,625 INFO [RS:0;jenkins-hbase9:36361] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:12,625 INFO [RS:0;jenkins-hbase9:36361] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:12,625 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:12,625 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(3304): Received CLOSE for ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:12,625 DEBUG [RS:0;jenkins-hbase9:36361] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f32789f to 127.0.0.1:52138 2023-02-17 22:01:12,625 DEBUG [RS:0;jenkins-hbase9:36361] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:12,625 INFO [RS:0;jenkins-hbase9:36361] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:12,625 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:12,625 DEBUG [RS:1;jenkins-hbase9:45019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e5f4585 to 127.0.0.1:52138 2023-02-17 22:01:12,625 DEBUG [RS:1;jenkins-hbase9:45019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:12,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:12,626 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:12,626 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:12,626 INFO [RS:0;jenkins-hbase9:36361] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:12,626 INFO [RS:0;jenkins-hbase9:36361] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:12,626 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:12,626 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 22:01:12,626 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1479): Online Regions={ec60fc0cd857d471a1f9cda92a612c25=hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25.} 2023-02-17 22:01:12,633 DEBUG [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1505): Waiting on ec60fc0cd857d471a1f9cda92a612c25 2023-02-17 22:01:12,638 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:12,638 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:12,642 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 22:01:12,642 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 22:01:12,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing ec60fc0cd857d471a1f9cda92a612c25, disabling compactions & flushes 2023-02-17 22:01:12,647 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 22:01:12,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:12,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:12,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. after waiting 0 ms 2023-02-17 22:01:12,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:12,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing ec60fc0cd857d471a1f9cda92a612c25 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:12,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:12,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:12,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:12,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:12,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:12,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-17 22:01:12,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/.tmp/info/fcbf87a2bdfd4051a99e1d6216d2bbc8 2023-02-17 22:01:12,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/.tmp/info/53aee7addc99471899112169b2b4a3d7 2023-02-17 22:01:12,692 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53aee7addc99471899112169b2b4a3d7 2023-02-17 22:01:12,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/.tmp/info/fcbf87a2bdfd4051a99e1d6216d2bbc8 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/info/fcbf87a2bdfd4051a99e1d6216d2bbc8 2023-02-17 22:01:12,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/info/fcbf87a2bdfd4051a99e1d6216d2bbc8, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:12,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ec60fc0cd857d471a1f9cda92a612c25 in 55ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:12,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/namespace/ec60fc0cd857d471a1f9cda92a612c25/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:12,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:12,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for ec60fc0cd857d471a1f9cda92a612c25: 2023-02-17 22:01:12,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671261530.ec60fc0cd857d471a1f9cda92a612c25. 2023-02-17 22:01:12,833 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45019,1676671259449; all regions closed. 2023-02-17 22:01:12,843 DEBUG [RS:1;jenkins-hbase9:45019] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/oldWALs 2023-02-17 22:01:12,843 INFO [RS:1;jenkins-hbase9:45019] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45019%2C1676671259449:(num 1676671261952) 2023-02-17 22:01:12,843 DEBUG [RS:1;jenkins-hbase9:45019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:12,844 INFO [RS:1;jenkins-hbase9:45019] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:12,844 INFO [RS:1;jenkins-hbase9:45019] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:12,844 INFO [RS:1;jenkins-hbase9:45019] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:12,844 INFO [RS:1;jenkins-hbase9:45019] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:12,844 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:12,844 INFO [RS:1;jenkins-hbase9:45019] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:12,846 INFO [RS:1;jenkins-hbase9:45019] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45019 2023-02-17 22:01:12,848 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 22:01:12,855 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:12,855 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:12,855 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45019,1676671259449 2023-02-17 22:01:12,855 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:12,855 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28fdbc59 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:12,855 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:12,855 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d391092 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:12,858 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45019,1676671259449] 2023-02-17 22:01:12,858 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45019,1676671259449; numProcessing=1 2023-02-17 22:01:12,859 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45019,1676671259449 already deleted, retry=false 2023-02-17 22:01:12,859 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45019,1676671259449 expired; onlineServers=1 2023-02-17 22:01:12,884 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 22:01:12,884 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 22:01:13,048 DEBUG [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 22:01:13,115 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:13,116 INFO [RS:1;jenkins-hbase9:45019] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45019,1676671259449; zookeeper connection closed. 2023-02-17 22:01:13,116 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65f08057 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:13,116 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72725b8d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72725b8d 2023-02-17 22:01:13,116 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x100644deaa80002, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:13,116 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c876502 rejected from java.util.concurrent.ThreadPoolExecutor@2cc23d9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:13,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/.tmp/rep_barrier/23979e26372f4b6b88225dd0b7017dd3 2023-02-17 22:01:13,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23979e26372f4b6b88225dd0b7017dd3 2023-02-17 22:01:13,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/.tmp/table/865f32fcb3964811b435ad8a2acaf4b8 2023-02-17 22:01:13,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 865f32fcb3964811b435ad8a2acaf4b8 2023-02-17 22:01:13,162 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/.tmp/info/53aee7addc99471899112169b2b4a3d7 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/info/53aee7addc99471899112169b2b4a3d7 2023-02-17 22:01:13,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53aee7addc99471899112169b2b4a3d7 2023-02-17 22:01:13,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/info/53aee7addc99471899112169b2b4a3d7, entries=30, sequenceid=57, filesize=7.9 K 2023-02-17 22:01:13,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/.tmp/rep_barrier/23979e26372f4b6b88225dd0b7017dd3 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/rep_barrier/23979e26372f4b6b88225dd0b7017dd3 2023-02-17 22:01:13,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23979e26372f4b6b88225dd0b7017dd3 2023-02-17 22:01:13,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/rep_barrier/23979e26372f4b6b88225dd0b7017dd3, entries=10, sequenceid=57, filesize=5.9 K 2023-02-17 22:01:13,179 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/.tmp/table/865f32fcb3964811b435ad8a2acaf4b8 as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/table/865f32fcb3964811b435ad8a2acaf4b8 2023-02-17 22:01:13,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 865f32fcb3964811b435ad8a2acaf4b8 2023-02-17 22:01:13,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/table/865f32fcb3964811b435ad8a2acaf4b8, entries=13, sequenceid=57, filesize=5.9 K 2023-02-17 22:01:13,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 534ms, sequenceid=57, compaction requested=false 2023-02-17 22:01:13,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-17 22:01:13,199 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:13,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:13,200 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:13,200 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:13,248 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,36361,1676671259402; all regions closed. 2023-02-17 22:01:13,255 DEBUG [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/oldWALs 2023-02-17 22:01:13,255 INFO [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36361%2C1676671259402.meta:.meta(num 1676671261239) 2023-02-17 22:01:13,261 DEBUG [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/oldWALs 2023-02-17 22:01:13,261 INFO [RS:0;jenkins-hbase9:36361] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36361%2C1676671259402:(num 1676671261951) 2023-02-17 22:01:13,261 DEBUG [RS:0;jenkins-hbase9:36361] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:13,261 INFO [RS:0;jenkins-hbase9:36361] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:13,262 INFO [RS:0;jenkins-hbase9:36361] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:13,262 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:13,263 INFO [RS:0;jenkins-hbase9:36361] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36361 2023-02-17 22:01:13,266 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36361,1676671259402 2023-02-17 22:01:13,266 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:13,266 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,36361,1676671259402] 2023-02-17 22:01:13,266 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,36361,1676671259402; numProcessing=2 2023-02-17 22:01:13,269 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,36361,1676671259402 already deleted, retry=false 2023-02-17 22:01:13,269 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,36361,1676671259402 expired; onlineServers=0 2023-02-17 22:01:13,269 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41817,1676671258155' ***** 2023-02-17 22:01:13,269 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:13,270 DEBUG [M:0;jenkins-hbase9:41817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d54b4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:13,270 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41817,1676671258155 2023-02-17 22:01:13,270 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41817,1676671258155; all regions closed. 2023-02-17 22:01:13,270 DEBUG [M:0;jenkins-hbase9:41817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:13,270 DEBUG [M:0;jenkins-hbase9:41817] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:13,270 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:13,270 DEBUG [M:0;jenkins-hbase9:41817] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:13,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671260704] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671260704,5,FailOnTimeoutGroup] 2023-02-17 22:01:13,270 INFO [M:0;jenkins-hbase9:41817] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:13,271 INFO [M:0;jenkins-hbase9:41817] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:13,271 INFO [M:0;jenkins-hbase9:41817] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:13,271 DEBUG [M:0;jenkins-hbase9:41817] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:13,271 INFO [M:0;jenkins-hbase9:41817] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:13,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671260705] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671260705,5,FailOnTimeoutGroup] 2023-02-17 22:01:13,272 ERROR [M:0;jenkins-hbase9:41817] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-17 22:01:13,273 INFO [M:0;jenkins-hbase9:41817] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:13,274 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:13,275 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:13,275 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:13,275 DEBUG [M:0;jenkins-hbase9:41817] zookeeper.ZKUtil(398): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:13,275 WARN [M:0;jenkins-hbase9:41817] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:13,275 INFO [M:0;jenkins-hbase9:41817] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:13,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:13,278 INFO [M:0;jenkins-hbase9:41817] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:13,278 DEBUG [M:0;jenkins-hbase9:41817] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:13,278 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:13,278 DEBUG [M:0;jenkins-hbase9:41817] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:13,278 DEBUG [M:0;jenkins-hbase9:41817] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:13,278 DEBUG [M:0;jenkins-hbase9:41817] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:13,278 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.26 KB heapSize=192.19 KB 2023-02-17 22:01:13,299 INFO [M:0;jenkins-hbase9:41817] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.26 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cc4ae70f3c5b44fd9f15ae53ba0a887b 2023-02-17 22:01:13,306 DEBUG [M:0;jenkins-hbase9:41817] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cc4ae70f3c5b44fd9f15ae53ba0a887b as hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cc4ae70f3c5b44fd9f15ae53ba0a887b 2023-02-17 22:01:13,311 INFO [M:0;jenkins-hbase9:41817] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/8526d47d-490e-7afd-6627-798163458ce5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cc4ae70f3c5b44fd9f15ae53ba0a887b, entries=53, sequenceid=357, filesize=10.4 K 2023-02-17 22:01:13,312 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegion(2947): Finished flush of dataSize ~159.26 KB/163087, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=357, compaction requested=false 2023-02-17 22:01:13,314 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:13,314 DEBUG [M:0;jenkins-hbase9:41817] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:13,320 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:13,320 INFO [M:0;jenkins-hbase9:41817] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:13,320 INFO [M:0;jenkins-hbase9:41817] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41817 2023-02-17 22:01:13,324 DEBUG [M:0;jenkins-hbase9:41817] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,41817,1676671258155 already deleted, retry=false 2023-02-17 22:01:13,368 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:13,368 INFO [RS:0;jenkins-hbase9:36361] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,36361,1676671259402; zookeeper connection closed. 2023-02-17 22:01:13,368 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e872d2d rejected from java.util.concurrent.ThreadPoolExecutor@3ab8be25[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:13,368 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): regionserver:36361-0x100644deaa80001, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:13,368 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4966afc9 rejected from java.util.concurrent.ThreadPoolExecutor@3ab8be25[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:13,369 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@47c7d65f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@47c7d65f 2023-02-17 22:01:13,369 INFO [Listener at localhost/34531] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:13,468 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:13,468 INFO [M:0;jenkins-hbase9:41817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41817,1676671258155; zookeeper connection closed. 2023-02-17 22:01:13,468 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@521cfeee rejected from java.util.concurrent.ThreadPoolExecutor@4e1af39b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:13,468 DEBUG [Listener at localhost/34531-EventThread] zookeeper.ZKWatcher(600): master:41817-0x100644deaa80000, quorum=127.0.0.1:52138, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:13,468 ERROR [Listener at localhost/34531-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79df93fb rejected from java.util.concurrent.ThreadPoolExecutor@4e1af39b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:13,470 WARN [Listener at localhost/34531] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:13,480 INFO [Listener at localhost/34531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:13,486 WARN [BP-674934899-172.31.2.10-1676671254538 heartbeating to localhost/127.0.0.1:37673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:13,486 WARN [BP-674934899-172.31.2.10-1676671254538 heartbeating to localhost/127.0.0.1:37673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-674934899-172.31.2.10-1676671254538 (Datanode Uuid 645b6eb2-b38b-4262-bb6a-a2ec68e4af0c) service to localhost/127.0.0.1:37673 2023-02-17 22:01:13,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/dfs/data/data3/current/BP-674934899-172.31.2.10-1676671254538] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:13,490 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/dfs/data/data4/current/BP-674934899-172.31.2.10-1676671254538] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:13,492 WARN [Listener at localhost/34531] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:13,499 INFO [Listener at localhost/34531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:13,506 WARN [BP-674934899-172.31.2.10-1676671254538 heartbeating to localhost/127.0.0.1:37673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:13,506 WARN [BP-674934899-172.31.2.10-1676671254538 heartbeating to localhost/127.0.0.1:37673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-674934899-172.31.2.10-1676671254538 (Datanode Uuid 101b72b6-f74c-4faa-a5c7-25920925dd47) service to localhost/127.0.0.1:37673 2023-02-17 22:01:13,507 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/dfs/data/data1/current/BP-674934899-172.31.2.10-1676671254538] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:13,507 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/cluster_4c50d43f-6eed-5522-5e5b-2bc4cb7e5dc9/dfs/data/data2/current/BP-674934899-172.31.2.10-1676671254538] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:13,546 INFO [Listener at localhost/34531] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:13,671 INFO [Listener at localhost/34531] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:13,757 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:13,777 INFO [Listener at localhost/34531] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:37673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:37673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:37673 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34531 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@1c9fc00f java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:37673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:37673 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,41817,1676671258155)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase9:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:37673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 220) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=7614 (was 9115) 2023-02-17 22:01:13,787 INFO [Listener at localhost/34531] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=337, ProcessCount=173, AvailableMemoryMB=7612 2023-02-17 22:01:13,803 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop.log.dir so I do NOT create it in target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60 2023-02-17 22:01:13,803 WARN [Listener at localhost/34531] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 22:01:13,804 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop.tmp.dir so I do NOT create it in target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60 2023-02-17 22:01:13,804 WARN [Listener at localhost/34531] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ad5fdb73-b222-6950-f861-dfbcc8aecf69/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 22:01:13,804 DEBUG [Listener at localhost/34531] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60 2023-02-17 22:01:13,804 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:01:13,804 INFO [Listener at localhost/34531] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729, deleteOnExit=true 2023-02-17 22:01:13,804 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:01:13,804 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/test.cache.data in system properties and HBase conf 2023-02-17 22:01:13,805 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:01:13,805 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:01:13,805 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:01:13,805 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:01:13,805 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:01:13,805 DEBUG [Listener at localhost/34531] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:01:13,806 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:13,806 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:13,806 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:01:13,806 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:13,807 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:01:13,807 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:01:13,807 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:13,807 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:13,807 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:01:13,808 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:01:13,808 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:01:13,808 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:13,808 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:01:13,808 INFO [Listener at localhost/34531] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:01:13,813 WARN [Listener at localhost/34531] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:13,813 WARN [Listener at localhost/34531] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:13,870 WARN [Listener at localhost/34531] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:13,873 INFO [Listener at localhost/34531] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:13,879 INFO [Listener at localhost/34531] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/java.io.tmpdir/Jetty_localhost_34399_hdfs____po1ikc/webapp 2023-02-17 22:01:13,992 INFO [Listener at localhost/34531] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34399 2023-02-17 22:01:13,996 WARN [Listener at localhost/34531] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:13,997 WARN [Listener at localhost/34531] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:14,040 WARN [Listener at localhost/33889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:14,053 WARN [Listener at localhost/33889] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:14,055 WARN [Listener at localhost/33889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:14,056 INFO [Listener at localhost/33889] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:14,065 INFO [Listener at localhost/33889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/java.io.tmpdir/Jetty_localhost_34241_datanode____.vg39bf/webapp 2023-02-17 22:01:14,174 INFO [Listener at localhost/33889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34241 2023-02-17 22:01:14,183 WARN [Listener at localhost/42195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:14,201 WARN [Listener at localhost/42195] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:14,204 WARN [Listener at localhost/42195] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:14,206 INFO [Listener at localhost/42195] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:14,210 INFO [Listener at localhost/42195] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/java.io.tmpdir/Jetty_localhost_46657_datanode____.yq9pc3/webapp 2023-02-17 22:01:14,309 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7efce89a3bf96486: Processing first storage report for DS-4363083f-f89f-4066-b248-7bea5b1c6bda from datanode 96971ca9-33af-4616-96ab-c145c9eceb9d 2023-02-17 22:01:14,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7efce89a3bf96486: from storage DS-4363083f-f89f-4066-b248-7bea5b1c6bda node DatanodeRegistration(127.0.0.1:38879, datanodeUuid=96971ca9-33af-4616-96ab-c145c9eceb9d, infoPort=37401, infoSecurePort=0, ipcPort=42195, storageInfo=lv=-57;cid=testClusterID;nsid=838666146;c=1676671273816), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 22:01:14,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7efce89a3bf96486: Processing first storage report for DS-495ca01a-34a8-4567-ad91-06f5e6d47fde from datanode 96971ca9-33af-4616-96ab-c145c9eceb9d 2023-02-17 22:01:14,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7efce89a3bf96486: from storage DS-495ca01a-34a8-4567-ad91-06f5e6d47fde node DatanodeRegistration(127.0.0.1:38879, datanodeUuid=96971ca9-33af-4616-96ab-c145c9eceb9d, infoPort=37401, infoSecurePort=0, ipcPort=42195, storageInfo=lv=-57;cid=testClusterID;nsid=838666146;c=1676671273816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:14,322 INFO [Listener at localhost/42195] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46657 2023-02-17 22:01:14,331 WARN [Listener at localhost/43847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:14,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ce24f7614cdb555: Processing first storage report for DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe from datanode 218a7d91-3da4-476b-8efc-3ed83e7a557a 2023-02-17 22:01:14,434 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ce24f7614cdb555: from storage DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe node DatanodeRegistration(127.0.0.1:34511, datanodeUuid=218a7d91-3da4-476b-8efc-3ed83e7a557a, infoPort=34589, infoSecurePort=0, ipcPort=43847, storageInfo=lv=-57;cid=testClusterID;nsid=838666146;c=1676671273816), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:14,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8ce24f7614cdb555: Processing first storage report for DS-5f8073d3-412d-4e79-9a92-3c917bf79559 from datanode 218a7d91-3da4-476b-8efc-3ed83e7a557a 2023-02-17 22:01:14,434 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8ce24f7614cdb555: from storage DS-5f8073d3-412d-4e79-9a92-3c917bf79559 node DatanodeRegistration(127.0.0.1:34511, datanodeUuid=218a7d91-3da4-476b-8efc-3ed83e7a557a, infoPort=34589, infoSecurePort=0, ipcPort=43847, storageInfo=lv=-57;cid=testClusterID;nsid=838666146;c=1676671273816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:14,443 DEBUG [Listener at localhost/43847] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60 2023-02-17 22:01:14,446 INFO [Listener at localhost/43847] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/zookeeper_0, clientPort=62481, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:01:14,447 INFO [Listener at localhost/43847] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62481 2023-02-17 22:01:14,447 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,448 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,464 INFO [Listener at localhost/43847] util.FSUtils(479): Created version file at hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91 with version=8 2023-02-17 22:01:14,464 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,465 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,466 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/hbase-staging 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:14,468 INFO [Listener at localhost/43847] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:14,470 INFO [Listener at localhost/43847] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45227 2023-02-17 22:01:14,470 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,471 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,472 INFO [Listener at localhost/43847] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45227 connecting to ZooKeeper ensemble=127.0.0.1:62481 2023-02-17 22:01:14,481 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:452270x0, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:14,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45227-0x100644e2dbb0000 connected 2023-02-17 22:01:14,501 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:14,502 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:14,502 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:14,503 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45227 2023-02-17 22:01:14,503 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45227 2023-02-17 22:01:14,503 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45227 2023-02-17 22:01:14,506 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45227 2023-02-17 22:01:14,507 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45227 2023-02-17 22:01:14,507 INFO [Listener at localhost/43847] master.HMaster(444): hbase.rootdir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91, hbase.cluster.distributed=false 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:14,521 INFO [Listener at localhost/43847] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:14,525 INFO [Listener at localhost/43847] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41709 2023-02-17 22:01:14,525 INFO [Listener at localhost/43847] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:14,526 DEBUG [Listener at localhost/43847] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:14,527 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,528 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,528 INFO [Listener at localhost/43847] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41709 connecting to ZooKeeper ensemble=127.0.0.1:62481 2023-02-17 22:01:14,531 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:417090x0, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:14,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41709-0x100644e2dbb0001 connected 2023-02-17 22:01:14,533 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:14,533 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:14,533 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:14,535 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41709 2023-02-17 22:01:14,536 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41709 2023-02-17 22:01:14,537 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41709 2023-02-17 22:01:14,537 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41709 2023-02-17 22:01:14,537 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41709 2023-02-17 22:01:14,553 INFO [Listener at localhost/43847] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:14,553 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,554 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,554 INFO [Listener at localhost/43847] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:14,554 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:14,554 INFO [Listener at localhost/43847] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:14,554 INFO [Listener at localhost/43847] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:14,556 INFO [Listener at localhost/43847] ipc.NettyRpcServer(120): Bind to /172.31.2.10:40799 2023-02-17 22:01:14,556 INFO [Listener at localhost/43847] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:14,559 DEBUG [Listener at localhost/43847] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:14,559 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,560 INFO [Listener at localhost/43847] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,561 INFO [Listener at localhost/43847] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40799 connecting to ZooKeeper ensemble=127.0.0.1:62481 2023-02-17 22:01:14,564 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:407990x0, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:14,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40799-0x100644e2dbb0002 connected 2023-02-17 22:01:14,565 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:14,566 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:14,566 DEBUG [Listener at localhost/43847] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:14,568 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40799 2023-02-17 22:01:14,568 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40799 2023-02-17 22:01:14,568 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40799 2023-02-17 22:01:14,569 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40799 2023-02-17 22:01:14,569 DEBUG [Listener at localhost/43847] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40799 2023-02-17 22:01:14,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,572 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:14,572 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,576 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:14,576 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:14,576 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,576 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:14,579 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:14,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:14,579 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,45227,1676671274467 from backup master directory 2023-02-17 22:01:14,580 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,580 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:14,580 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:14,580 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,596 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/hbase.id with ID: 13627da6-852e-49dd-8fba-143bfc8ff7c2 2023-02-17 22:01:14,606 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:14,609 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,621 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4f180153 to 127.0.0.1:62481 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:14,626 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18471895, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:14,626 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:14,626 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:01:14,627 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:14,628 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store-tmp 2023-02-17 22:01:14,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:14,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:14,639 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:14,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:14,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:14,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:14,639 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:14,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:14,640 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/WALs/jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,642 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45227%2C1676671274467, suffix=, logDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/WALs/jenkins-hbase9.apache.org,45227,1676671274467, archiveDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:14,665 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK] 2023-02-17 22:01:14,665 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK] 2023-02-17 22:01:14,671 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/WALs/jenkins-hbase9.apache.org,45227,1676671274467/jenkins-hbase9.apache.org%2C45227%2C1676671274467.1676671274643 2023-02-17 22:01:14,671 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK], DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK]] 2023-02-17 22:01:14,671 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:14,672 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:14,672 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:14,672 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:14,675 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:14,676 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:14,677 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:14,677 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:14,678 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:14,678 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:14,681 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:14,683 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:14,683 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59339324, jitterRate=-0.11577516794204712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:14,683 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:14,684 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:14,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:14,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:14,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:14,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 22:01:14,686 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 22:01:14,686 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:14,687 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:14,688 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:14,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:14,700 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:14,700 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:14,700 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:14,700 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:14,703 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:14,704 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:14,704 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:14,706 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:14,706 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:14,706 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:14,706 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,706 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,45227,1676671274467, sessionid=0x100644e2dbb0000, setting cluster-up flag (Was=false) 2023-02-17 22:01:14,710 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,717 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:14,718 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,726 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:14,727 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:14,727 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.hbase-snapshot/.tmp 2023-02-17 22:01:14,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:14,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:14,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:14,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:14,730 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:14,730 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:14,730 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,730 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:14,730 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671304734 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:14,735 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,736 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:14,736 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:14,736 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:14,736 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:14,736 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:14,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:14,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:14,737 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671274737,5,FailOnTimeoutGroup] 2023-02-17 22:01:14,737 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671274737,5,FailOnTimeoutGroup] 2023-02-17 22:01:14,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:14,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,738 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:14,749 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:14,749 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:14,749 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91 2023-02-17 22:01:14,759 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:14,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:14,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/info 2023-02-17 22:01:14,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:14,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:14,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:14,763 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:14,764 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:14,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:14,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:14,765 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/table 2023-02-17 22:01:14,766 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:14,766 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:14,767 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740 2023-02-17 22:01:14,767 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740 2023-02-17 22:01:14,769 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:14,770 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:14,772 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(952): ClusterId : 13627da6-852e-49dd-8fba-143bfc8ff7c2 2023-02-17 22:01:14,772 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:14,773 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(952): ClusterId : 13627da6-852e-49dd-8fba-143bfc8ff7c2 2023-02-17 22:01:14,773 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:14,777 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:14,778 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74326138, jitterRate=0.10754576325416565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:14,778 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:14,778 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:14,778 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:14,778 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:14,778 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:14,778 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:14,778 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:14,778 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:14,779 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:14,779 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:14,779 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:14,779 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:14,780 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:14,780 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:14,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:14,781 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:14,783 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:14,784 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:14,784 DEBUG [RS:0;jenkins-hbase9:41709] zookeeper.ReadOnlyZKClient(139): Connect 0x5143c77e to 127.0.0.1:62481 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:14,784 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:14,786 DEBUG [RS:1;jenkins-hbase9:40799] zookeeper.ReadOnlyZKClient(139): Connect 0x0be808ab to 127.0.0.1:62481 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:14,797 DEBUG [RS:1;jenkins-hbase9:40799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52ff7a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:14,797 DEBUG [RS:0;jenkins-hbase9:41709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f843326, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:14,797 DEBUG [RS:1;jenkins-hbase9:40799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11063db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:14,797 DEBUG [RS:0;jenkins-hbase9:41709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bbbac0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:14,809 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:41709 2023-02-17 22:01:14,809 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:40799 2023-02-17 22:01:14,810 INFO [RS:0;jenkins-hbase9:41709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:14,810 INFO [RS:1;jenkins-hbase9:40799] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:14,810 INFO [RS:1;jenkins-hbase9:40799] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:14,810 INFO [RS:0;jenkins-hbase9:41709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:14,810 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:14,810 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:14,811 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,45227,1676671274467 with isa=jenkins-hbase9.apache.org/172.31.2.10:41709, startcode=1676671274520 2023-02-17 22:01:14,811 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,45227,1676671274467 with isa=jenkins-hbase9.apache.org/172.31.2.10:40799, startcode=1676671274553 2023-02-17 22:01:14,811 DEBUG [RS:0;jenkins-hbase9:41709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:14,811 DEBUG [RS:1;jenkins-hbase9:40799] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:14,820 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53541, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:14,821 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58529, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:14,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45227] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,823 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91 2023-02-17 22:01:14,823 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33889 2023-02-17 22:01:14,823 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:14,823 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91 2023-02-17 22:01:14,823 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33889 2023-02-17 22:01:14,823 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:14,829 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:14,830 DEBUG [RS:1;jenkins-hbase9:40799] zookeeper.ZKUtil(162): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,830 DEBUG [RS:0;jenkins-hbase9:41709] zookeeper.ZKUtil(162): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,830 WARN [RS:1;jenkins-hbase9:40799] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:14,830 WARN [RS:0;jenkins-hbase9:41709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:14,830 INFO [RS:1;jenkins-hbase9:40799] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:14,830 INFO [RS:0;jenkins-hbase9:41709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:14,831 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,831 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,831 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,40799,1676671274553] 2023-02-17 22:01:14,831 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41709,1676671274520] 2023-02-17 22:01:14,840 DEBUG [RS:1;jenkins-hbase9:40799] zookeeper.ZKUtil(162): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,841 DEBUG [RS:0;jenkins-hbase9:41709] zookeeper.ZKUtil(162): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,841 DEBUG [RS:1;jenkins-hbase9:40799] zookeeper.ZKUtil(162): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,841 DEBUG [RS:0;jenkins-hbase9:41709] zookeeper.ZKUtil(162): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,842 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:14,842 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:14,843 INFO [RS:0;jenkins-hbase9:41709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:14,843 INFO [RS:1;jenkins-hbase9:40799] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:14,851 INFO [RS:0;jenkins-hbase9:41709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:14,851 INFO [RS:1;jenkins-hbase9:40799] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:14,858 INFO [RS:0;jenkins-hbase9:41709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:14,858 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,858 INFO [RS:1;jenkins-hbase9:40799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:14,859 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,859 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:14,860 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:14,861 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,862 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,862 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:0;jenkins-hbase9:41709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,863 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,864 DEBUG [RS:1;jenkins-hbase9:40799] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:14,868 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,868 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,868 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,868 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,868 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,868 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,887 INFO [RS:0;jenkins-hbase9:41709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:14,887 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41709,1676671274520-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,890 INFO [RS:1;jenkins-hbase9:40799] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:14,891 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40799,1676671274553-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:14,906 INFO [RS:0;jenkins-hbase9:41709] regionserver.Replication(203): jenkins-hbase9.apache.org,41709,1676671274520 started 2023-02-17 22:01:14,906 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41709,1676671274520, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41709, sessionid=0x100644e2dbb0001 2023-02-17 22:01:14,906 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:14,906 DEBUG [RS:0;jenkins-hbase9:41709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,906 DEBUG [RS:0;jenkins-hbase9:41709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41709,1676671274520' 2023-02-17 22:01:14,906 DEBUG [RS:0;jenkins-hbase9:41709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:14,907 DEBUG [RS:0;jenkins-hbase9:41709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41709,1676671274520' 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:14,908 DEBUG [RS:0;jenkins-hbase9:41709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:14,909 INFO [RS:0;jenkins-hbase9:41709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:14,909 INFO [RS:0;jenkins-hbase9:41709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:14,910 INFO [RS:1;jenkins-hbase9:40799] regionserver.Replication(203): jenkins-hbase9.apache.org,40799,1676671274553 started 2023-02-17 22:01:14,910 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,40799,1676671274553, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:40799, sessionid=0x100644e2dbb0002 2023-02-17 22:01:14,910 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:14,910 DEBUG [RS:1;jenkins-hbase9:40799] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,910 DEBUG [RS:1;jenkins-hbase9:40799] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40799,1676671274553' 2023-02-17 22:01:14,911 DEBUG [RS:1;jenkins-hbase9:40799] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:14,911 DEBUG [RS:1;jenkins-hbase9:40799] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:14,911 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:14,911 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:14,912 DEBUG [RS:1;jenkins-hbase9:40799] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:14,912 DEBUG [RS:1;jenkins-hbase9:40799] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40799,1676671274553' 2023-02-17 22:01:14,912 DEBUG [RS:1;jenkins-hbase9:40799] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:14,912 DEBUG [RS:1;jenkins-hbase9:40799] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:14,912 DEBUG [RS:1;jenkins-hbase9:40799] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:14,913 INFO [RS:1;jenkins-hbase9:40799] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:14,913 INFO [RS:1;jenkins-hbase9:40799] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:14,934 DEBUG [jenkins-hbase9:45227] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:14,934 DEBUG [jenkins-hbase9:45227] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:14,937 DEBUG [jenkins-hbase9:45227] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:14,937 DEBUG [jenkins-hbase9:45227] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:14,937 DEBUG [jenkins-hbase9:45227] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:14,938 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40799,1676671274553, state=OPENING 2023-02-17 22:01:14,940 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:14,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40799,1676671274553}] 2023-02-17 22:01:14,943 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:14,943 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:15,101 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:15,102 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:15,105 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40200, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:15,109 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:15,109 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:15,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40799%2C1676671274553.meta, suffix=.meta, logDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,40799,1676671274553, archiveDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/oldWALs, maxLogs=32 2023-02-17 22:01:15,130 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK] 2023-02-17 22:01:15,130 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK] 2023-02-17 22:01:15,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,40799,1676671274553/jenkins-hbase9.apache.org%2C40799%2C1676671274553.meta.1676671275113.meta 2023-02-17 22:01:15,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK], DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK]] 2023-02-17 22:01:15,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:15,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:15,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:15,134 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:15,134 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:15,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:15,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:15,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:15,137 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/info 2023-02-17 22:01:15,137 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/info 2023-02-17 22:01:15,138 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:15,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:15,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:15,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:15,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:15,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:15,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:15,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:15,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/table 2023-02-17 22:01:15,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/table 2023-02-17 22:01:15,141 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:15,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:15,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740 2023-02-17 22:01:15,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740 2023-02-17 22:01:15,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:15,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:15,148 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63045992, jitterRate=-0.060541510581970215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:15,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:15,155 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671275101 2023-02-17 22:01:15,159 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:15,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:15,160 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40799,1676671274553, state=OPEN 2023-02-17 22:01:15,162 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:15,162 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:15,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:15,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40799,1676671274553 in 220 msec 2023-02-17 22:01:15,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:15,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 384 msec 2023-02-17 22:01:15,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 439 msec 2023-02-17 22:01:15,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671275169, completionTime=-1 2023-02-17 22:01:15,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:15,170 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:15,173 DEBUG [hconnection-0x231235e5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:15,175 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40206, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:15,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:15,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671335177 2023-02-17 22:01:15,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671395177 2023-02-17 22:01:15,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-17 22:01:15,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45227,1676671274467-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:15,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45227,1676671274467-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:15,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45227,1676671274467-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:15,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:45227, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:15,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:15,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:15,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:15,186 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:15,186 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:15,187 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:15,188 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:15,190 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,190 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb empty. 2023-02-17 22:01:15,191 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,191 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:15,209 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:15,211 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 040160ac83c0dcea7440b1e785990deb, NAME => 'hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 040160ac83c0dcea7440b1e785990deb, disabling compactions & flushes 2023-02-17 22:01:15,225 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. after waiting 0 ms 2023-02-17 22:01:15,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,225 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,225 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 040160ac83c0dcea7440b1e785990deb: 2023-02-17 22:01:15,229 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:15,230 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671275230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275230"}]},"ts":"1676671275230"} 2023-02-17 22:01:15,233 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:15,234 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:15,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671275234"}]},"ts":"1676671275234"} 2023-02-17 22:01:15,235 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:15,240 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:15,241 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:15,241 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:15,241 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:15,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=040160ac83c0dcea7440b1e785990deb, ASSIGN}] 2023-02-17 22:01:15,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=040160ac83c0dcea7440b1e785990deb, ASSIGN 2023-02-17 22:01:15,245 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=040160ac83c0dcea7440b1e785990deb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41709,1676671274520; forceNewPlan=false, retain=false 2023-02-17 22:01:15,395 INFO [jenkins-hbase9:45227] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:15,396 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=040160ac83c0dcea7440b1e785990deb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:15,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671275396"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671275396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671275396"}]},"ts":"1676671275396"} 2023-02-17 22:01:15,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 040160ac83c0dcea7440b1e785990deb, server=jenkins-hbase9.apache.org,41709,1676671274520}] 2023-02-17 22:01:15,551 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:15,552 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:15,554 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:15,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41709%2C1676671274520, suffix=, logDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,41709,1676671274520, archiveDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/oldWALs, maxLogs=32 2023-02-17 22:01:15,585 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK] 2023-02-17 22:01:15,585 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK] 2023-02-17 22:01:15,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,41709,1676671274520/jenkins-hbase9.apache.org%2C41709%2C1676671274520.1676671275562 2023-02-17 22:01:15,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK], DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK]] 2023-02-17 22:01:15,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 040160ac83c0dcea7440b1e785990deb, NAME => 'hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:15,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,591 INFO [StoreOpener-040160ac83c0dcea7440b1e785990deb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,592 DEBUG [StoreOpener-040160ac83c0dcea7440b1e785990deb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/info 2023-02-17 22:01:15,592 DEBUG [StoreOpener-040160ac83c0dcea7440b1e785990deb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/info 2023-02-17 22:01:15,593 INFO [StoreOpener-040160ac83c0dcea7440b1e785990deb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 040160ac83c0dcea7440b1e785990deb columnFamilyName info 2023-02-17 22:01:15,593 INFO [StoreOpener-040160ac83c0dcea7440b1e785990deb-1] regionserver.HStore(310): Store=040160ac83c0dcea7440b1e785990deb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:15,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:15,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:15,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 040160ac83c0dcea7440b1e785990deb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68358489, jitterRate=0.018620863556861877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:15,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 040160ac83c0dcea7440b1e785990deb: 2023-02-17 22:01:15,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb., pid=6, masterSystemTime=1676671275551 2023-02-17 22:01:15,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:15,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=040160ac83c0dcea7440b1e785990deb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:15,607 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671275606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671275606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671275606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671275606"}]},"ts":"1676671275606"} 2023-02-17 22:01:15,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:15,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 040160ac83c0dcea7440b1e785990deb, server=jenkins-hbase9.apache.org,41709,1676671274520 in 210 msec 2023-02-17 22:01:15,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:15,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=040160ac83c0dcea7440b1e785990deb, ASSIGN in 369 msec 2023-02-17 22:01:15,613 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:15,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671275613"}]},"ts":"1676671275613"} 2023-02-17 22:01:15,614 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:15,617 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:15,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 433 msec 2023-02-17 22:01:15,687 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:15,688 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:15,688 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:15,692 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:15,696 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41016, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:15,698 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:15,725 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:15,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-02-17 22:01:15,743 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:15,753 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:15,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-17 22:01:15,772 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:15,774 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:15,774 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.194sec 2023-02-17 22:01:15,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:15,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:15,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:15,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45227,1676671274467-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:15,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45227,1676671274467-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:15,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:15,874 DEBUG [Listener at localhost/43847] zookeeper.ReadOnlyZKClient(139): Connect 0x6ae69468 to 127.0.0.1:62481 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:15,881 DEBUG [Listener at localhost/43847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bc9668f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:15,882 DEBUG [hconnection-0x49ef3b7a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:15,886 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:15,887 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:15,888 DEBUG [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:15,889 DEBUG [Listener at localhost/43847] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:15,891 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:15,891 INFO [Listener at localhost/43847] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 22:01:15,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-17 22:01:15,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:15,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.2.10:57040 deadline: 1676671335892, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 22:01:15,893 INFO [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 22:01:15,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:15,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 22:01:15,899 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:15,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 22:01:15,899 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:15,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d empty. 2023-02-17 22:01:15,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5 empty. 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99 empty. 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6 empty. 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:15,910 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:15,909 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a empty. 2023-02-17 22:01:15,910 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04 empty. 2023-02-17 22:01:15,910 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c empty. 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc empty. 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa empty. 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0 empty. 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:15,911 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:15,912 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 22:01:15,914 INFO [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40799%2C1676671274553, suffix=, logDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,40799,1676671274553, archiveDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/oldWALs, maxLogs=32 2023-02-17 22:01:15,926 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:15,927 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d79bb42e50e0858865e07bb1e742228d, NAME => 'testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,927 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e72f6f91525ad2a00a0aad25e4750df6, NAME => 'testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,927 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 77122379f24b212e77917d634d12df04, NAME => 'testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,930 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK] 2023-02-17 22:01:15,935 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK] 2023-02-17 22:01:15,937 INFO [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,40799,1676671274553/jenkins-hbase9.apache.org%2C40799%2C1676671274553.1676671275915 2023-02-17 22:01:15,938 DEBUG [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34511,DS-bf8d0c36-a6fc-4674-8c51-d1451edac6fe,DISK], DatanodeInfoWithStorage[127.0.0.1:38879,DS-4363083f-f89f-4066-b248-7bea5b1c6bda,DISK]] 2023-02-17 22:01:15,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 77122379f24b212e77917d634d12df04, disabling compactions & flushes 2023-02-17 22:01:15,947 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:15,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:15,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. after waiting 0 ms 2023-02-17 22:01:15,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:15,947 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:15,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:15,948 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1181fc63c2835ef1ddd4d20b45eeaa7c, NAME => 'testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e72f6f91525ad2a00a0aad25e4750df6, disabling compactions & flushes 2023-02-17 22:01:15,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:15,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:15,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. after waiting 0 ms 2023-02-17 22:01:15,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:15,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:15,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:15,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b8f972b5de712f7adcec23aa37d255c5, NAME => 'testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d79bb42e50e0858865e07bb1e742228d, disabling compactions & flushes 2023-02-17 22:01:15,953 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. after waiting 0 ms 2023-02-17 22:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:15,953 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:15,953 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:15,954 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fa2ed7019381e0d1e1784ad608dbf5cc, NAME => 'testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b8f972b5de712f7adcec23aa37d255c5, disabling compactions & flushes 2023-02-17 22:01:15,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:15,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:15,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. after waiting 0 ms 2023-02-17 22:01:15,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:15,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:15,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:15,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a3f95e6118883152eff6745a0de70c99, NAME => 'testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1181fc63c2835ef1ddd4d20b45eeaa7c, disabling compactions & flushes 2023-02-17 22:01:15,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. after waiting 0 ms 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:15,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fa2ed7019381e0d1e1784ad608dbf5cc, disabling compactions & flushes 2023-02-17 22:01:15,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:15,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1f620b5280ca333cec490d0f7011ae1a, NAME => 'testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. after waiting 0 ms 2023-02-17 22:01:15,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:15,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:15,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:15,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 21f4c91b6f12e0a7c98e7f8c2ca844b0, NAME => 'testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a3f95e6118883152eff6745a0de70c99, disabling compactions & flushes 2023-02-17 22:01:15,979 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. after waiting 0 ms 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:15,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1f620b5280ca333cec490d0f7011ae1a, disabling compactions & flushes 2023-02-17 22:01:15,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:15,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:15,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:15,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:15,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b34d5c817bbfe966332f6e672d7e76fa, NAME => 'testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.tmp 2023-02-17 22:01:15,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. after waiting 0 ms 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:15,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 21f4c91b6f12e0a7c98e7f8c2ca844b0, disabling compactions & flushes 2023-02-17 22:01:15,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. after waiting 0 ms 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:15,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:15,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:15,991 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:15,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b34d5c817bbfe966332f6e672d7e76fa, disabling compactions & flushes 2023-02-17 22:01:15,992 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:15,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:15,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. after waiting 0 ms 2023-02-17 22:01:15,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:15,992 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:15,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:15,994 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676671275895.77122379f24b212e77917d634d12df04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671275995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671275995"}]},"ts":"1676671275995"} 2023-02-17 22:01:15,999 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 22:01:16,000 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:16,000 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671276000"}]},"ts":"1676671276000"} 2023-02-17 22:01:16,002 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 22:01:16,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:16,005 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:16,013 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:16,013 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:16,013 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:16,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d79bb42e50e0858865e07bb1e742228d, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e72f6f91525ad2a00a0aad25e4750df6, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77122379f24b212e77917d634d12df04, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1181fc63c2835ef1ddd4d20b45eeaa7c, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b8f972b5de712f7adcec23aa37d255c5, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fa2ed7019381e0d1e1784ad608dbf5cc, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3f95e6118883152eff6745a0de70c99, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1f620b5280ca333cec490d0f7011ae1a, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=21f4c91b6f12e0a7c98e7f8c2ca844b0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b34d5c817bbfe966332f6e672d7e76fa, ASSIGN}] 2023-02-17 22:01:16,016 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e72f6f91525ad2a00a0aad25e4750df6, ASSIGN 2023-02-17 22:01:16,016 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1181fc63c2835ef1ddd4d20b45eeaa7c, ASSIGN 2023-02-17 22:01:16,016 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d79bb42e50e0858865e07bb1e742228d, ASSIGN 2023-02-17 22:01:16,016 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77122379f24b212e77917d634d12df04, ASSIGN 2023-02-17 22:01:16,019 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e72f6f91525ad2a00a0aad25e4750df6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41709,1676671274520; forceNewPlan=false, retain=false 2023-02-17 22:01:16,019 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d79bb42e50e0858865e07bb1e742228d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40799,1676671274553; forceNewPlan=false, retain=false 2023-02-17 22:01:16,019 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=77122379f24b212e77917d634d12df04, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40799,1676671274553; forceNewPlan=false, retain=false 2023-02-17 22:01:16,019 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b34d5c817bbfe966332f6e672d7e76fa, ASSIGN 2023-02-17 22:01:16,019 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1181fc63c2835ef1ddd4d20b45eeaa7c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40799,1676671274553; forceNewPlan=false, retain=false 2023-02-17 22:01:16,020 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=21f4c91b6f12e0a7c98e7f8c2ca844b0, ASSIGN 2023-02-17 22:01:16,020 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1f620b5280ca333cec490d0f7011ae1a, ASSIGN 2023-02-17 22:01:16,021 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3f95e6118883152eff6745a0de70c99, ASSIGN 2023-02-17 22:01:16,021 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b34d5c817bbfe966332f6e672d7e76fa, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41709,1676671274520; forceNewPlan=false, retain=false 2023-02-17 22:01:16,021 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fa2ed7019381e0d1e1784ad608dbf5cc, ASSIGN 2023-02-17 22:01:16,021 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=21f4c91b6f12e0a7c98e7f8c2ca844b0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40799,1676671274553; forceNewPlan=false, retain=false 2023-02-17 22:01:16,021 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1f620b5280ca333cec490d0f7011ae1a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41709,1676671274520; forceNewPlan=false, retain=false 2023-02-17 22:01:16,022 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a3f95e6118883152eff6745a0de70c99, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40799,1676671274553; forceNewPlan=false, retain=false 2023-02-17 22:01:16,022 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b8f972b5de712f7adcec23aa37d255c5, ASSIGN 2023-02-17 22:01:16,022 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fa2ed7019381e0d1e1784ad608dbf5cc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41709,1676671274520; forceNewPlan=false, retain=false 2023-02-17 22:01:16,023 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b8f972b5de712f7adcec23aa37d255c5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41709,1676671274520; forceNewPlan=false, retain=false 2023-02-17 22:01:16,170 INFO [jenkins-hbase9:45227] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 22:01:16,175 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1f620b5280ca333cec490d0f7011ae1a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,175 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e72f6f91525ad2a00a0aad25e4750df6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,175 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b34d5c817bbfe966332f6e672d7e76fa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,175 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b8f972b5de712f7adcec23aa37d255c5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,175 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fa2ed7019381e0d1e1784ad608dbf5cc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,175 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671276175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276175"}]},"ts":"1676671276175"} 2023-02-17 22:01:16,175 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276175"}]},"ts":"1676671276175"} 2023-02-17 22:01:16,175 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276175"}]},"ts":"1676671276175"} 2023-02-17 22:01:16,175 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276175"}]},"ts":"1676671276175"} 2023-02-17 22:01:16,175 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276175"}]},"ts":"1676671276175"} 2023-02-17 22:01:16,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure fa2ed7019381e0d1e1784ad608dbf5cc, server=jenkins-hbase9.apache.org,41709,1676671274520}] 2023-02-17 22:01:16,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure b34d5c817bbfe966332f6e672d7e76fa, server=jenkins-hbase9.apache.org,41709,1676671274520}] 2023-02-17 22:01:16,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure e72f6f91525ad2a00a0aad25e4750df6, server=jenkins-hbase9.apache.org,41709,1676671274520}] 2023-02-17 22:01:16,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure 1f620b5280ca333cec490d0f7011ae1a, server=jenkins-hbase9.apache.org,41709,1676671274520}] 2023-02-17 22:01:16,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure b8f972b5de712f7adcec23aa37d255c5, server=jenkins-hbase9.apache.org,41709,1676671274520}] 2023-02-17 22:01:16,183 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=21f4c91b6f12e0a7c98e7f8c2ca844b0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,183 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276183"}]},"ts":"1676671276183"} 2023-02-17 22:01:16,185 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a3f95e6118883152eff6745a0de70c99, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,185 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d79bb42e50e0858865e07bb1e742228d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,185 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276185"}]},"ts":"1676671276185"} 2023-02-17 22:01:16,185 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671276185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276185"}]},"ts":"1676671276185"} 2023-02-17 22:01:16,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure 21f4c91b6f12e0a7c98e7f8c2ca844b0, server=jenkins-hbase9.apache.org,40799,1676671274553}] 2023-02-17 22:01:16,189 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=77122379f24b212e77917d634d12df04, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1181fc63c2835ef1ddd4d20b45eeaa7c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,189 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676671275895.77122379f24b212e77917d634d12df04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276189"}]},"ts":"1676671276189"} 2023-02-17 22:01:16,189 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671276189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671276189"}]},"ts":"1676671276189"} 2023-02-17 22:01:16,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure a3f95e6118883152eff6745a0de70c99, server=jenkins-hbase9.apache.org,40799,1676671274553}] 2023-02-17 22:01:16,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure d79bb42e50e0858865e07bb1e742228d, server=jenkins-hbase9.apache.org,40799,1676671274553}] 2023-02-17 22:01:16,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 77122379f24b212e77917d634d12df04, server=jenkins-hbase9.apache.org,40799,1676671274553}] 2023-02-17 22:01:16,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 1181fc63c2835ef1ddd4d20b45eeaa7c, server=jenkins-hbase9.apache.org,40799,1676671274553}] 2023-02-17 22:01:16,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:16,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:16,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b34d5c817bbfe966332f6e672d7e76fa, NAME => 'testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 22:01:16,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,336 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,337 DEBUG [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/f1 2023-02-17 22:01:16,338 DEBUG [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/f1 2023-02-17 22:01:16,338 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b34d5c817bbfe966332f6e672d7e76fa columnFamilyName f1 2023-02-17 22:01:16,339 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(310): Store=b34d5c817bbfe966332f6e672d7e76fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,339 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,340 DEBUG [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/f2 2023-02-17 22:01:16,340 DEBUG [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/f2 2023-02-17 22:01:16,341 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b34d5c817bbfe966332f6e672d7e76fa columnFamilyName f2 2023-02-17 22:01:16,341 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(310): Store=b34d5c817bbfe966332f6e672d7e76fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77122379f24b212e77917d634d12df04, NAME => 'testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 22:01:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:16,346 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,348 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1 2023-02-17 22:01:16,348 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1 2023-02-17 22:01:16,348 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77122379f24b212e77917d634d12df04 columnFamilyName f1 2023-02-17 22:01:16,349 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(310): Store=77122379f24b212e77917d634d12df04/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,349 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened b34d5c817bbfe966332f6e672d7e76fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60137604, jitterRate=-0.10387986898422241}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:16,350 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2 2023-02-17 22:01:16,350 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2 2023-02-17 22:01:16,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa., pid=22, masterSystemTime=1676671276330 2023-02-17 22:01:16,350 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77122379f24b212e77917d634d12df04 columnFamilyName f2 2023-02-17 22:01:16,351 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(310): Store=77122379f24b212e77917d634d12df04/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:16,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:16,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:16,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e72f6f91525ad2a00a0aad25e4750df6, NAME => 'testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 22:01:16,353 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b34d5c817bbfe966332f6e672d7e76fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,353 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671276352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276352"}]},"ts":"1676671276352"} 2023-02-17 22:01:16,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,354 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,356 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1 2023-02-17 22:01:16,356 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1 2023-02-17 22:01:16,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 77122379f24b212e77917d634d12df04 2023-02-17 22:01:16,356 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e72f6f91525ad2a00a0aad25e4750df6 columnFamilyName f1 2023-02-17 22:01:16,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-17 22:01:16,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure b34d5c817bbfe966332f6e672d7e76fa, server=jenkins-hbase9.apache.org,41709,1676671274520 in 175 msec 2023-02-17 22:01:16,357 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(310): Store=e72f6f91525ad2a00a0aad25e4750df6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,357 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b34d5c817bbfe966332f6e672d7e76fa, ASSIGN in 344 msec 2023-02-17 22:01:16,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 77122379f24b212e77917d634d12df04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69414949, jitterRate=0.03436334431171417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,360 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2 2023-02-17 22:01:16,360 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2 2023-02-17 22:01:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:16,360 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e72f6f91525ad2a00a0aad25e4750df6 columnFamilyName f2 2023-02-17 22:01:16,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04., pid=29, masterSystemTime=1676671276341 2023-02-17 22:01:16,361 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(310): Store=e72f6f91525ad2a00a0aad25e4750df6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:16,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:16,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1181fc63c2835ef1ddd4d20b45eeaa7c, NAME => 'testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 22:01:16,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,364 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,366 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1 2023-02-17 22:01:16,366 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1 2023-02-17 22:01:16,366 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1181fc63c2835ef1ddd4d20b45eeaa7c columnFamilyName f1 2023-02-17 22:01:16,366 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=77122379f24b212e77917d634d12df04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676671275895.77122379f24b212e77917d634d12df04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276366"}]},"ts":"1676671276366"} 2023-02-17 22:01:16,366 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(310): Store=1181fc63c2835ef1ddd4d20b45eeaa7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,367 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:16,368 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2 2023-02-17 22:01:16,368 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2 2023-02-17 22:01:16,369 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1181fc63c2835ef1ddd4d20b45eeaa7c columnFamilyName f2 2023-02-17 22:01:16,369 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(310): Store=1181fc63c2835ef1ddd4d20b45eeaa7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e72f6f91525ad2a00a0aad25e4750df6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61335359, jitterRate=-0.08603192865848541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:16,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-17 22:01:16,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 77122379f24b212e77917d634d12df04, server=jenkins-hbase9.apache.org,40799,1676671274553 in 169 msec 2023-02-17 22:01:16,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6., pid=23, masterSystemTime=1676671276330 2023-02-17 22:01:16,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77122379f24b212e77917d634d12df04, ASSIGN in 357 msec 2023-02-17 22:01:16,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:16,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:16,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1f620b5280ca333cec490d0f7011ae1a, NAME => 'testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 22:01:16,373 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e72f6f91525ad2a00a0aad25e4750df6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,373 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276373"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276373"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276373"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276373"}]},"ts":"1676671276373"} 2023-02-17 22:01:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:16,374 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,376 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1 2023-02-17 22:01:16,376 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1 2023-02-17 22:01:16,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-17 22:01:16,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure e72f6f91525ad2a00a0aad25e4750df6, server=jenkins-hbase9.apache.org,41709,1676671274520 in 196 msec 2023-02-17 22:01:16,377 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f620b5280ca333cec490d0f7011ae1a columnFamilyName f1 2023-02-17 22:01:16,377 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(310): Store=1f620b5280ca333cec490d0f7011ae1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e72f6f91525ad2a00a0aad25e4750df6, ASSIGN in 363 msec 2023-02-17 22:01:16,378 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,379 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2 2023-02-17 22:01:16,379 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2 2023-02-17 22:01:16,379 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f620b5280ca333cec490d0f7011ae1a columnFamilyName f2 2023-02-17 22:01:16,380 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(310): Store=1f620b5280ca333cec490d0f7011ae1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1181fc63c2835ef1ddd4d20b45eeaa7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74881857, jitterRate=0.11582662165164948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:16,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c., pid=30, masterSystemTime=1676671276341 2023-02-17 22:01:16,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:16,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:16,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:16,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d79bb42e50e0858865e07bb1e742228d, NAME => 'testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 22:01:16,387 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1181fc63c2835ef1ddd4d20b45eeaa7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276386"}]},"ts":"1676671276386"} 2023-02-17 22:01:16,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,389 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-17 22:01:16,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 1181fc63c2835ef1ddd4d20b45eeaa7c, server=jenkins-hbase9.apache.org,40799,1676671274553 in 189 msec 2023-02-17 22:01:16,391 DEBUG [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/f1 2023-02-17 22:01:16,391 DEBUG [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/f1 2023-02-17 22:01:16,392 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d79bb42e50e0858865e07bb1e742228d columnFamilyName f1 2023-02-17 22:01:16,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1181fc63c2835ef1ddd4d20b45eeaa7c, ASSIGN in 378 msec 2023-02-17 22:01:16,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:16,395 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(310): Store=d79bb42e50e0858865e07bb1e742228d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,395 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1f620b5280ca333cec490d0f7011ae1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67036550, jitterRate=-0.0010775625705718994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:16,397 DEBUG [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/f2 2023-02-17 22:01:16,397 DEBUG [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/f2 2023-02-17 22:01:16,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a., pid=24, masterSystemTime=1676671276330 2023-02-17 22:01:16,397 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d79bb42e50e0858865e07bb1e742228d columnFamilyName f2 2023-02-17 22:01:16,398 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(310): Store=d79bb42e50e0858865e07bb1e742228d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:16,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:16,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:16,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fa2ed7019381e0d1e1784ad608dbf5cc, NAME => 'testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 22:01:16,399 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1f620b5280ca333cec490d0f7011ae1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,399 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276399"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276399"}]},"ts":"1676671276399"} 2023-02-17 22:01:16,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,401 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-17 22:01:16,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure 1f620b5280ca333cec490d0f7011ae1a, server=jenkins-hbase9.apache.org,41709,1676671274520 in 220 msec 2023-02-17 22:01:16,404 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1 2023-02-17 22:01:16,404 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1 2023-02-17 22:01:16,405 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa2ed7019381e0d1e1784ad608dbf5cc columnFamilyName f1 2023-02-17 22:01:16,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1f620b5280ca333cec490d0f7011ae1a, ASSIGN in 390 msec 2023-02-17 22:01:16,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:16,405 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(310): Store=fa2ed7019381e0d1e1784ad608dbf5cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,406 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,407 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2 2023-02-17 22:01:16,407 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2 2023-02-17 22:01:16,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,408 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa2ed7019381e0d1e1784ad608dbf5cc columnFamilyName f2 2023-02-17 22:01:16,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d79bb42e50e0858865e07bb1e742228d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70785142, jitterRate=0.054780811071395874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,408 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(310): Store=fa2ed7019381e0d1e1784ad608dbf5cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:16,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d., pid=28, masterSystemTime=1676671276341 2023-02-17 22:01:16,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:16,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:16,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:16,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3f95e6118883152eff6745a0de70c99, NAME => 'testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 22:01:16,411 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d79bb42e50e0858865e07bb1e742228d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,412 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676671276411"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276411"}]},"ts":"1676671276411"} 2023-02-17 22:01:16,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,414 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:16,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-17 22:01:16,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure d79bb42e50e0858865e07bb1e742228d, server=jenkins-hbase9.apache.org,40799,1676671274553 in 222 msec 2023-02-17 22:01:16,416 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1 2023-02-17 22:01:16,417 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1 2023-02-17 22:01:16,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d79bb42e50e0858865e07bb1e742228d, ASSIGN in 403 msec 2023-02-17 22:01:16,417 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3f95e6118883152eff6745a0de70c99 columnFamilyName f1 2023-02-17 22:01:16,418 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(310): Store=a3f95e6118883152eff6745a0de70c99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,418 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,420 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2 2023-02-17 22:01:16,420 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2 2023-02-17 22:01:16,420 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3f95e6118883152eff6745a0de70c99 columnFamilyName f2 2023-02-17 22:01:16,421 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(310): Store=a3f95e6118883152eff6745a0de70c99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened fa2ed7019381e0d1e1784ad608dbf5cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65249447, jitterRate=-0.027707472443580627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:16,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc., pid=21, masterSystemTime=1676671276330 2023-02-17 22:01:16,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:16,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:16,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:16,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b8f972b5de712f7adcec23aa37d255c5, NAME => 'testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 22:01:16,427 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fa2ed7019381e0d1e1784ad608dbf5cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,427 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276427"}]},"ts":"1676671276427"} 2023-02-17 22:01:16,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:16,430 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a3f95e6118883152eff6745a0de70c99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66945731, jitterRate=-0.0024308711290359497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:16,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-17 22:01:16,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure fa2ed7019381e0d1e1784ad608dbf5cc, server=jenkins-hbase9.apache.org,41709,1676671274520 in 251 msec 2023-02-17 22:01:16,432 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1 2023-02-17 22:01:16,432 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1 2023-02-17 22:01:16,432 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8f972b5de712f7adcec23aa37d255c5 columnFamilyName f1 2023-02-17 22:01:16,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99., pid=27, masterSystemTime=1676671276341 2023-02-17 22:01:16,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fa2ed7019381e0d1e1784ad608dbf5cc, ASSIGN in 419 msec 2023-02-17 22:01:16,433 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(310): Store=b8f972b5de712f7adcec23aa37d255c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,433 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:16,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:16,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 21f4c91b6f12e0a7c98e7f8c2ca844b0, NAME => 'testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 22:01:16,435 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2 2023-02-17 22:01:16,435 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2 2023-02-17 22:01:16,435 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a3f95e6118883152eff6745a0de70c99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:16,435 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276435"}]},"ts":"1676671276435"} 2023-02-17 22:01:16,435 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8f972b5de712f7adcec23aa37d255c5 columnFamilyName f2 2023-02-17 22:01:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,436 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(310): Store=b8f972b5de712f7adcec23aa37d255c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,437 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,438 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1 2023-02-17 22:01:16,438 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1 2023-02-17 22:01:16,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,438 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f4c91b6f12e0a7c98e7f8c2ca844b0 columnFamilyName f1 2023-02-17 22:01:16,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,439 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(310): Store=21f4c91b6f12e0a7c98e7f8c2ca844b0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,439 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-17 22:01:16,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure a3f95e6118883152eff6745a0de70c99, server=jenkins-hbase9.apache.org,40799,1676671274553 in 248 msec 2023-02-17 22:01:16,441 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2 2023-02-17 22:01:16,441 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2 2023-02-17 22:01:16,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,441 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f4c91b6f12e0a7c98e7f8c2ca844b0 columnFamilyName f2 2023-02-17 22:01:16,441 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(310): Store=21f4c91b6f12e0a7c98e7f8c2ca844b0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:16,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3f95e6118883152eff6745a0de70c99, ASSIGN in 427 msec 2023-02-17 22:01:16,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:16,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:16,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened b8f972b5de712f7adcec23aa37d255c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66577447, jitterRate=-0.00791873037815094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:16,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5., pid=25, masterSystemTime=1676671276330 2023-02-17 22:01:16,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:16,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:16,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:16,448 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b8f972b5de712f7adcec23aa37d255c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:16,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276447"}]},"ts":"1676671276447"} 2023-02-17 22:01:16,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:16,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 21f4c91b6f12e0a7c98e7f8c2ca844b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75085645, jitterRate=0.1188632994890213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:16,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:16,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0., pid=26, masterSystemTime=1676671276341 2023-02-17 22:01:16,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-17 22:01:16,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure b8f972b5de712f7adcec23aa37d255c5, server=jenkins-hbase9.apache.org,41709,1676671274520 in 267 msec 2023-02-17 22:01:16,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:16,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:16,452 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=21f4c91b6f12e0a7c98e7f8c2ca844b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:16,452 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676671276452"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671276452"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671276452"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671276452"}]},"ts":"1676671276452"} 2023-02-17 22:01:16,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b8f972b5de712f7adcec23aa37d255c5, ASSIGN in 438 msec 2023-02-17 22:01:16,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-17 22:01:16,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure 21f4c91b6f12e0a7c98e7f8c2ca844b0, server=jenkins-hbase9.apache.org,40799,1676671274553 in 268 msec 2023-02-17 22:01:16,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-17 22:01:16,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=21f4c91b6f12e0a7c98e7f8c2ca844b0, ASSIGN in 443 msec 2023-02-17 22:01:16,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:16,458 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671276458"}]},"ts":"1676671276458"} 2023-02-17 22:01:16,460 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 22:01:16,463 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:16,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 567 msec 2023-02-17 22:01:16,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:16,505 INFO [Listener at localhost/43847] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 22:01:16,505 DEBUG [Listener at localhost/43847] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 22:01:16,506 INFO [Listener at localhost/43847] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:16,509 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 22:01:16,509 INFO [Listener at localhost/43847] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:16,509 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 22:01:16,509 INFO [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:16,552 DEBUG [hconnection-0x49ef3b7a-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:16,579 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:16,590 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41709] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:16,591 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40799] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:16,668 INFO [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:16,668 INFO [Listener at localhost/43847] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:16,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:16,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671276670 (current time:1676671276670). 2023-02-17 22:01:16,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:16,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] zookeeper.ReadOnlyZKClient(139): Connect 0x3bf9b0e0 to 127.0.0.1:62481 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:16,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ed49f39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:16,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:16,679 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:16,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bf9b0e0 to 127.0.0.1:62481 2023-02-17 22:01:16,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:16,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:16,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:16,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:16,687 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:16,688 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676671876688 2023-02-17 22:01:16,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:16,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 22:01:16,692 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:16,692 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:16,693 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:16,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:16,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-17 22:01:16,694 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:16,695 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676671876695 2023-02-17 22:01:16,793 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:16,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:16,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:16,795 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:16,995 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:16,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:16,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:16,997 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 22:01:17,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,157 INFO [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-17 22:01:17,158 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:17,158 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-17 22:01:17,158 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-17 22:01:17,158 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,158 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,160 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:17,160 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:17,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:17,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:17,160 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:17,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:17,161 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,161 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,162 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,162 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:17,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-17 22:01:17,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,162 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 22:01:17,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-17 22:01:17,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,163 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-17 22:01:17,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 22:01:17,163 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:17,164 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-17 22:01:17,164 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-17 22:01:17,164 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41709,1676671274520' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-17 22:01:17,166 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,166 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:17,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:17,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,167 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,167 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:17,167 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-17 22:01:17,167 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:17,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:17,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:17,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41709,1676671274520' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-17 22:01:17,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d625776[Count = 1] remaining members to acquire global barrier 2023-02-17 22:01:17,175 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-17 22:01:17,175 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-17 22:01:17,175 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40799,1676671274553' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-17 22:01:17,176 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,176 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:17,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:17,177 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,177 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:17,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:17,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:17,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:17,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40799,1676671274553' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-17 22:01:17,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d625776[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:17,179 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-17 22:01:17,179 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,180 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:17,180 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:17,180 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,180 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:17,181 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. started... 2023-02-17 22:01:17,181 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,181 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:17,183 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b8f972b5de712f7adcec23aa37d255c5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:17,183 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:17,183 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. started... 2023-02-17 22:01:17,187 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 22:01:17,187 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1f620b5280ca333cec490d0f7011ae1a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:17,187 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:17,187 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:17,187 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:17,188 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. started... 2023-02-17 22:01:17,188 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 22:01:17,188 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:17,188 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. started... 2023-02-17 22:01:17,189 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e72f6f91525ad2a00a0aad25e4750df6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 22:01:17,190 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:17,190 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,190 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,190 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:17,190 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:17,189 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:17,189 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:17,195 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. started... 2023-02-17 22:01:17,195 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. started... 2023-02-17 22:01:17,196 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 21f4c91b6f12e0a7c98e7f8c2ca844b0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 22:01:17,196 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 77122379f24b212e77917d634d12df04 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:17,247 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. completed. 2023-02-17 22:01:17,248 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:17,248 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:17,248 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 22:01:17,248 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. started... 2023-02-17 22:01:17,258 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1181fc63c2835ef1ddd4d20b45eeaa7c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:17,267 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f1/eb569764081e4d9598935c77a56ac0cd 2023-02-17 22:01:17,287 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f1/33d6504202c74894b4d6d43977ec8754 2023-02-17 22:01:17,297 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:17,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:17,299 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 22:01:17,303 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f1/bc4b094961aa4a4abbf3f573a04823ff 2023-02-17 22:01:17,312 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f1/59e57331634b46e1b55a0342bea1d5a3 2023-02-17 22:01:17,323 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f1/c2dc4fc6fae54239b7f1d82049cec603 2023-02-17 22:01:17,339 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f1/9bf718bb7b324494b1d9a6193ec16097 2023-02-17 22:01:17,341 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f2/3f6330cbe71e4ce486a9ccbdf76ae81e 2023-02-17 22:01:17,350 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f1/eb569764081e4d9598935c77a56ac0cd as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/eb569764081e4d9598935c77a56ac0cd 2023-02-17 22:01:17,357 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/eb569764081e4d9598935c77a56ac0cd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,358 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f2/3f6330cbe71e4ce486a9ccbdf76ae81e as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/3f6330cbe71e4ce486a9ccbdf76ae81e 2023-02-17 22:01:17,375 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f2/dc08ddb323ea496bb405b280d21ee763 2023-02-17 22:01:17,383 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f2/82326f8a310a46f0bcaa300b4038c5b6 2023-02-17 22:01:17,385 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/3f6330cbe71e4ce486a9ccbdf76ae81e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,386 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 77122379f24b212e77917d634d12df04 in 190ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,386 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/eb569764081e4d9598935c77a56ac0cd] hfiles 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/eb569764081e4d9598935c77a56ac0cd for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/3f6330cbe71e4ce486a9ccbdf76ae81e] hfiles 2023-02-17 22:01:17,387 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/3f6330cbe71e4ce486a9ccbdf76ae81e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,395 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f1/33d6504202c74894b4d6d43977ec8754 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/33d6504202c74894b4d6d43977ec8754 2023-02-17 22:01:17,397 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 22:01:17,407 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/33d6504202c74894b4d6d43977ec8754, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,408 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f2/dc08ddb323ea496bb405b280d21ee763 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/dc08ddb323ea496bb405b280d21ee763 2023-02-17 22:01:17,431 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f2/2544c4a2398c42c09685a5887e9a02b7 2023-02-17 22:01:17,434 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f1/59e57331634b46e1b55a0342bea1d5a3 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/59e57331634b46e1b55a0342bea1d5a3 2023-02-17 22:01:17,446 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f1/bc4b094961aa4a4abbf3f573a04823ff as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/bc4b094961aa4a4abbf3f573a04823ff 2023-02-17 22:01:17,447 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/59e57331634b46e1b55a0342bea1d5a3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:17,448 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f2/82326f8a310a46f0bcaa300b4038c5b6 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/82326f8a310a46f0bcaa300b4038c5b6 2023-02-17 22:01:17,457 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/bc4b094961aa4a4abbf3f573a04823ff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,458 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f2/2544c4a2398c42c09685a5887e9a02b7 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/2544c4a2398c42c09685a5887e9a02b7 2023-02-17 22:01:17,475 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f2/8f49a8f72cb04e4da314cbce929a6c12 2023-02-17 22:01:17,488 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/dc08ddb323ea496bb405b280d21ee763, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,491 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/82326f8a310a46f0bcaa300b4038c5b6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:17,495 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1f620b5280ca333cec490d0f7011ae1a in 308ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,496 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/2544c4a2398c42c09685a5887e9a02b7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,497 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e72f6f91525ad2a00a0aad25e4750df6 in 308ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,497 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. completed. 2023-02-17 22:01:17,497 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:17,497 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:17,497 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. started... 2023-02-17 22:01:17,497 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 22:01:17,497 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a3f95e6118883152eff6745a0de70c99 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:17,499 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b8f972b5de712f7adcec23aa37d255c5 in 316ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/59e57331634b46e1b55a0342bea1d5a3] hfiles 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/59e57331634b46e1b55a0342bea1d5a3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/82326f8a310a46f0bcaa300b4038c5b6] hfiles 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/82326f8a310a46f0bcaa300b4038c5b6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,501 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f2/35c326b91e19446d8b3a99847423b20b 2023-02-17 22:01:17,500 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/33d6504202c74894b4d6d43977ec8754] hfiles 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/33d6504202c74894b4d6d43977ec8754 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/dc08ddb323ea496bb405b280d21ee763] hfiles 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/dc08ddb323ea496bb405b280d21ee763 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/bc4b094961aa4a4abbf3f573a04823ff] hfiles 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/bc4b094961aa4a4abbf3f573a04823ff for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/2544c4a2398c42c09685a5887e9a02b7] hfiles 2023-02-17 22:01:17,501 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/2544c4a2398c42c09685a5887e9a02b7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,508 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f1/9bf718bb7b324494b1d9a6193ec16097 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/9bf718bb7b324494b1d9a6193ec16097 2023-02-17 22:01:17,510 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f1/c2dc4fc6fae54239b7f1d82049cec603 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/c2dc4fc6fae54239b7f1d82049cec603 2023-02-17 22:01:17,514 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/9bf718bb7b324494b1d9a6193ec16097, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,516 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f2/35c326b91e19446d8b3a99847423b20b as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/35c326b91e19446d8b3a99847423b20b 2023-02-17 22:01:17,525 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/c2dc4fc6fae54239b7f1d82049cec603, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:17,528 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f2/8f49a8f72cb04e4da314cbce929a6c12 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/8f49a8f72cb04e4da314cbce929a6c12 2023-02-17 22:01:17,528 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/35c326b91e19446d8b3a99847423b20b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,529 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1181fc63c2835ef1ddd4d20b45eeaa7c in 271ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/9bf718bb7b324494b1d9a6193ec16097] hfiles 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/9bf718bb7b324494b1d9a6193ec16097 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/35c326b91e19446d8b3a99847423b20b] hfiles 2023-02-17 22:01:17,530 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/35c326b91e19446d8b3a99847423b20b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,557 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. completed. 2023-02-17 22:01:17,557 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:17,557 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:17,557 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 22:01:17,557 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. started... 2023-02-17 22:01:17,557 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:17,557 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,558 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,558 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:17,558 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:17,566 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/8f49a8f72cb04e4da314cbce929a6c12, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:17,567 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. completed. 2023-02-17 22:01:17,567 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:17,567 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:17,567 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 22:01:17,567 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. started... 2023-02-17 22:01:17,568 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegion(2744): Flushing fa2ed7019381e0d1e1784ad608dbf5cc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:17,569 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 21f4c91b6f12e0a7c98e7f8c2ca844b0 in 373ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/c2dc4fc6fae54239b7f1d82049cec603] hfiles 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/c2dc4fc6fae54239b7f1d82049cec603 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/8f49a8f72cb04e4da314cbce929a6c12] hfiles 2023-02-17 22:01:17,570 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/8f49a8f72cb04e4da314cbce929a6c12 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,580 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. completed. 2023-02-17 22:01:17,580 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:17,580 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 22:01:17,582 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f1/83a0f598e38a49c0b38061a56a7dd86f 2023-02-17 22:01:17,625 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. completed. 2023-02-17 22:01:17,625 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:17,625 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 22:01:17,626 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f1/a606953e089441efa8e5c12e39d48dc3 2023-02-17 22:01:17,627 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. completed. 2023-02-17 22:01:17,627 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:17,627 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 22:01:17,627 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. completed. 2023-02-17 22:01:17,627 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:17,627 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 22:01:17,643 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f2/92f99468720f455ead045c2263b1b8fa 2023-02-17 22:01:17,650 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f1/83a0f598e38a49c0b38061a56a7dd86f as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/83a0f598e38a49c0b38061a56a7dd86f 2023-02-17 22:01:17,656 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/83a0f598e38a49c0b38061a56a7dd86f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,657 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f2/92f99468720f455ead045c2263b1b8fa as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/92f99468720f455ead045c2263b1b8fa 2023-02-17 22:01:17,659 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f2/b6bcac13a7cb4ca2a6bbfd3033d71511 2023-02-17 22:01:17,666 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/92f99468720f455ead045c2263b1b8fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,667 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a3f95e6118883152eff6745a0de70c99 in 170ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f1/a606953e089441efa8e5c12e39d48dc3 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/a606953e089441efa8e5c12e39d48dc3 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/83a0f598e38a49c0b38061a56a7dd86f] hfiles 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/83a0f598e38a49c0b38061a56a7dd86f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/92f99468720f455ead045c2263b1b8fa] hfiles 2023-02-17 22:01:17,667 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/92f99468720f455ead045c2263b1b8fa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,672 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/a606953e089441efa8e5c12e39d48dc3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,673 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f2/b6bcac13a7cb4ca2a6bbfd3033d71511 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/b6bcac13a7cb4ca2a6bbfd3033d71511 2023-02-17 22:01:17,679 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. completed. 2023-02-17 22:01:17,679 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:17,679 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 22:01:17,679 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 22:01:17,679 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,680 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-17 22:01:17,680 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase9.apache.org,40799,1676671274553' in zk 2023-02-17 22:01:17,680 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/b6bcac13a7cb4ca2a6bbfd3033d71511, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:17,681 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fa2ed7019381e0d1e1784ad608dbf5cc in 113ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/a606953e089441efa8e5c12e39d48dc3] hfiles 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/a606953e089441efa8e5c12e39d48dc3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/b6bcac13a7cb4ca2a6bbfd3033d71511] hfiles 2023-02-17 22:01:17,681 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/b6bcac13a7cb4ca2a6bbfd3033d71511 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,682 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,682 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-17 22:01:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:17,682 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:17,682 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-17 22:01:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase9.apache.org,40799,1676671274553': 2023-02-17 22:01:17,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40799,1676671274553' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 22:01:17,698 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. completed. 2023-02-17 22:01:17,698 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:17,698 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 22:01:17,698 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 22:01:17,698 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,698 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-17 22:01:17,698 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase9.apache.org,41709,1676671274520' in zk 2023-02-17 22:01:17,701 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-17 22:01:17,701 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,701 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:17,702 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-17 22:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase9.apache.org,41709,1676671274520': 2023-02-17 22:01:17,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41709,1676671274520' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:17,706 INFO [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-17 22:01:17,706 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:17,706 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:17,706 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,706 INFO [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:17,707 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:17,707 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,707 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,708 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:17,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,708 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:17,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:17,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:17,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,709 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:17,709 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:17,711 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,712 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,719 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:17,719 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:17,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:17,719 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:17,719 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:17,719 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:17,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:17,720 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:17,719 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:17,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:17,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:17,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,721 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,799 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:17,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:17,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:17,801 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-17 22:01:17,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-17 22:01:17,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,811 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:17,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676671276691Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676671277721 (+1030 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676671277721Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676671277736 (+15 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676671277751 (+15 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676671277811 (+60 ms) 2023-02-17 22:01:17,813 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:17,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1210 sec 2023-02-17 22:01:18,802 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:18,806 INFO [Listener at localhost/43847] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:18,811 INFO [Listener at localhost/43847] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:18,828 INFO [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:19,133 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40799] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:19,135 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41709] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:19,212 INFO [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:19,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:19,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 22:01:19,227 INFO [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 22:01:19,227 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:19,228 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 22:01:19,228 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 22:01:19,229 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,229 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,231 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:19,231 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:19,231 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:19,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,232 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,232 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,232 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,232 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 22:01:19,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 22:01:19,235 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 22:01:19,235 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:19,239 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 22:01:19,240 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 22:01:19,240 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:19,240 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 22:01:19,240 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:19,240 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:19,240 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:19,240 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. started... 2023-02-17 22:01:19,241 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 22:01:19,240 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. started... 2023-02-17 22:01:19,240 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:19,241 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1f620b5280ca333cec490d0f7011ae1a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:19,241 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:19,240 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. started... 2023-02-17 22:01:19,241 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. started... 2023-02-17 22:01:19,241 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e72f6f91525ad2a00a0aad25e4750df6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 22:01:19,241 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 21f4c91b6f12e0a7c98e7f8c2ca844b0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 22:01:19,241 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b8f972b5de712f7adcec23aa37d255c5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:19,249 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:19,249 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. started... 2023-02-17 22:01:19,249 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:19,249 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:19,251 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 22:01:19,251 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:19,251 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:19,252 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. started... 2023-02-17 22:01:19,251 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:19,252 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 22:01:19,252 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. started... 2023-02-17 22:01:19,252 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 77122379f24b212e77917d634d12df04 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:19,252 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1181fc63c2835ef1ddd4d20b45eeaa7c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:19,340 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f1/27859c51889f4180b8d99cccb40197e2 2023-02-17 22:01:19,341 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f1/76980760d5a64634965b5be85035f03c 2023-02-17 22:01:19,342 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f1/c34e1a98c2a542398a06034efe362271 2023-02-17 22:01:19,367 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f1/f3b09de5e525422bb891912f280bf26e 2023-02-17 22:01:19,383 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f1/49800dc44c8247b8a70511c8240e0031 2023-02-17 22:01:19,412 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f2/050f783d14924b008f282e4c66a09310 2023-02-17 22:01:19,413 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f2/5c40549fdfbb4e39adbb080c8454ca04 2023-02-17 22:01:19,420 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f1/76980760d5a64634965b5be85035f03c as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/76980760d5a64634965b5be85035f03c 2023-02-17 22:01:19,421 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f2/3a82c54853374f7286866b9bcc3a6d01 2023-02-17 22:01:19,422 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f1/c34e1a98c2a542398a06034efe362271 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/c34e1a98c2a542398a06034efe362271 2023-02-17 22:01:19,425 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f2/1c54872255da438395986b6aa3bc09b1 2023-02-17 22:01:19,429 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f1/27859c51889f4180b8d99cccb40197e2 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/27859c51889f4180b8d99cccb40197e2 2023-02-17 22:01:19,430 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/76980760d5a64634965b5be85035f03c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:19,431 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/c34e1a98c2a542398a06034efe362271, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,436 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/.tmp/f2/050f783d14924b008f282e4c66a09310 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/050f783d14924b008f282e4c66a09310 2023-02-17 22:01:19,436 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/27859c51889f4180b8d99cccb40197e2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:19,436 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/.tmp/f2/5c40549fdfbb4e39adbb080c8454ca04 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/5c40549fdfbb4e39adbb080c8454ca04 2023-02-17 22:01:19,436 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f1/49800dc44c8247b8a70511c8240e0031 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/49800dc44c8247b8a70511c8240e0031 2023-02-17 22:01:19,437 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/.tmp/f2/3a82c54853374f7286866b9bcc3a6d01 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/3a82c54853374f7286866b9bcc3a6d01 2023-02-17 22:01:19,443 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/5c40549fdfbb4e39adbb080c8454ca04, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,444 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/3a82c54853374f7286866b9bcc3a6d01, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:19,444 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/49800dc44c8247b8a70511c8240e0031, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,445 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 21f4c91b6f12e0a7c98e7f8c2ca844b0 in 204ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,445 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1f620b5280ca333cec490d0f7011ae1a in 204ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,445 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:19,445 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:19,445 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:19,445 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:19,445 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 22:01:19,446 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/.tmp/f2/1c54872255da438395986b6aa3bc09b1 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/1c54872255da438395986b6aa3bc09b1 2023-02-17 22:01:19,445 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:19,446 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. started... 2023-02-17 22:01:19,446 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a3f95e6118883152eff6745a0de70c99 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:19,445 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:19,447 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. started... 2023-02-17 22:01:19,445 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 22:01:19,447 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:19,446 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/050f783d14924b008f282e4c66a09310, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:19,447 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:19,450 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:19,450 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 22:01:19,450 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. started... 2023-02-17 22:01:19,451 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e72f6f91525ad2a00a0aad25e4750df6 in 210ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,451 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fa2ed7019381e0d1e1784ad608dbf5cc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:19,451 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:19,451 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:19,451 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 22:01:19,457 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/1c54872255da438395986b6aa3bc09b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,467 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b8f972b5de712f7adcec23aa37d255c5 in 226ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,467 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:19,467 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:19,467 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 22:01:19,474 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f1/f1a0edefc1fe40afb7cafac265985381 2023-02-17 22:01:19,491 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f1/fbd8f1fd98ff4f15b9577ce222b77cba 2023-02-17 22:01:19,499 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f2/1871b539df8140fe8bf4ba27b6ddb783 2023-02-17 22:01:19,506 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f1/f1a0edefc1fe40afb7cafac265985381 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/f1a0edefc1fe40afb7cafac265985381 2023-02-17 22:01:19,512 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/f1a0edefc1fe40afb7cafac265985381, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,513 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/.tmp/f2/1871b539df8140fe8bf4ba27b6ddb783 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/1871b539df8140fe8bf4ba27b6ddb783 2023-02-17 22:01:19,520 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/1871b539df8140fe8bf4ba27b6ddb783, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,521 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a3f95e6118883152eff6745a0de70c99 in 75ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,521 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:19,521 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:19,521 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 22:01:19,523 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f2/4a378b35b6824d28a17b61c3e081844d 2023-02-17 22:01:19,535 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f1/fbd8f1fd98ff4f15b9577ce222b77cba as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/fbd8f1fd98ff4f15b9577ce222b77cba 2023-02-17 22:01:19,542 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/fbd8f1fd98ff4f15b9577ce222b77cba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,546 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/.tmp/f2/4a378b35b6824d28a17b61c3e081844d as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/4a378b35b6824d28a17b61c3e081844d 2023-02-17 22:01:19,551 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/4a378b35b6824d28a17b61c3e081844d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,552 INFO [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fa2ed7019381e0d1e1784ad608dbf5cc in 101ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,553 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:19,553 DEBUG [rs(jenkins-hbase9.apache.org,41709,1676671274520)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:19,553 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 22:01:19,553 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 22:01:19,553 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,553 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 22:01:19,553 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41709,1676671274520' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 22:01:19,555 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,555 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:19,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:19,556 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,556 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:19,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:19,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:19,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41709,1676671274520' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 22:01:19,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@195dc002[Count = 1] remaining members to acquire global barrier 2023-02-17 22:01:19,777 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f1/811e089a8ff84379bf9e831f3dae20eb 2023-02-17 22:01:19,792 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f2/d166ff40002f499ca997dfa13263d694 2023-02-17 22:01:19,798 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f1/811e089a8ff84379bf9e831f3dae20eb as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/811e089a8ff84379bf9e831f3dae20eb 2023-02-17 22:01:19,806 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/811e089a8ff84379bf9e831f3dae20eb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,808 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/.tmp/f2/d166ff40002f499ca997dfa13263d694 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/d166ff40002f499ca997dfa13263d694 2023-02-17 22:01:19,815 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/d166ff40002f499ca997dfa13263d694, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,816 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1181fc63c2835ef1ddd4d20b45eeaa7c in 564ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,816 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:19,816 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:19,816 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 22:01:19,820 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f2/ed5c5c06412a44718b35d48d4866a71a 2023-02-17 22:01:19,837 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f1/f3b09de5e525422bb891912f280bf26e as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/f3b09de5e525422bb891912f280bf26e 2023-02-17 22:01:19,842 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/f3b09de5e525422bb891912f280bf26e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,843 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/.tmp/f2/ed5c5c06412a44718b35d48d4866a71a as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/ed5c5c06412a44718b35d48d4866a71a 2023-02-17 22:01:19,847 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/ed5c5c06412a44718b35d48d4866a71a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:19,848 INFO [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 77122379f24b212e77917d634d12df04 in 596ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:19,848 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:19,848 DEBUG [rs(jenkins-hbase9.apache.org,40799,1676671274553)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:19,848 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 22:01:19,849 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 22:01:19,849 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,849 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 22:01:19,849 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40799,1676671274553' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 22:01:19,850 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,850 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:19,851 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:19,851 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:19,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40799,1676671274553' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 22:01:19,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@195dc002[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:19,852 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 22:01:19,852 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,853 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,853 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,854 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,854 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 22:01:19,854 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 22:01:19,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,854 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,41709,1676671274520' in zk 2023-02-17 22:01:19,854 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 22:01:19,854 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 22:01:19,854 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,854 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:19,854 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,40799,1676671274553' in zk 2023-02-17 22:01:19,856 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 22:01:19,856 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,856 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:19,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:19,856 DEBUG [member: 'jenkins-hbase9.apache.org,41709,1676671274520' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 22:01:19,857 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 22:01:19,857 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,857 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:19,858 DEBUG [member: 'jenkins-hbase9.apache.org,40799,1676671274553' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 22:01:19,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:19,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,41709,1676671274520': 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41709,1676671274520' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,40799,1676671274553': 2023-02-17 22:01:19,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40799,1676671274553' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 22:01:19,864 INFO [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 22:01:19,864 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:19,864 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:19,864 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 22:01:19,864 INFO [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:19,865 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,865 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:19,865 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,865 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,866 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:19,866 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:19,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:19,866 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,869 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,869 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:19,872 DEBUG [(jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:19,873 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:19,872 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:19,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 22:01:19,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:19,873 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,874 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,874 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:19,874 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:19,874 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:19,874 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:19,974 DEBUG [Listener at localhost/43847] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:19,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45227] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:19,976 INFO [Listener at localhost/43847] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:19,976 DEBUG [Listener at localhost/43847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ae69468 to 127.0.0.1:62481 2023-02-17 22:01:19,976 DEBUG [Listener at localhost/43847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:19,976 DEBUG [Listener at localhost/43847] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:19,976 DEBUG [Listener at localhost/43847] util.JVMClusterUtil(257): Found active master hash=457569054, stopped=false 2023-02-17 22:01:19,977 INFO [Listener at localhost/43847] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:19,979 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:19,979 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:19,979 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:19,979 INFO [Listener at localhost/43847] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:19,979 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:19,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:19,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:19,981 DEBUG [Listener at localhost/43847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f180153 to 127.0.0.1:62481 2023-02-17 22:01:19,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:19,981 DEBUG [Listener at localhost/43847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:19,981 INFO [Listener at localhost/43847] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41709,1676671274520' ***** 2023-02-17 22:01:19,981 INFO [Listener at localhost/43847] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:19,981 INFO [Listener at localhost/43847] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,40799,1676671274553' ***** 2023-02-17 22:01:19,981 INFO [Listener at localhost/43847] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:19,981 INFO [RS:0;jenkins-hbase9:41709] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:19,981 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:19,982 INFO [RS:1;jenkins-hbase9:40799] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:19,982 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:19,982 INFO [RS:0;jenkins-hbase9:41709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:19,983 INFO [RS:0;jenkins-hbase9:41709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(3304): Received CLOSE for b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:19,982 INFO [RS:1;jenkins-hbase9:40799] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(3304): Received CLOSE for 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:19,984 INFO [RS:1;jenkins-hbase9:40799] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(3304): Received CLOSE for e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:19,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing b8f972b5de712f7adcec23aa37d255c5, disabling compactions & flushes 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(3304): Received CLOSE for 040160ac83c0dcea7440b1e785990deb 2023-02-17 22:01:19,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(3304): Received CLOSE for b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:19,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:19,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. after waiting 0 ms 2023-02-17 22:01:19,984 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(3304): Received CLOSE for 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:19,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(3304): Received CLOSE for fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:19,984 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:19,984 DEBUG [RS:0;jenkins-hbase9:41709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5143c77e to 127.0.0.1:62481 2023-02-17 22:01:19,984 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(3304): Received CLOSE for d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:19,984 DEBUG [RS:0;jenkins-hbase9:41709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:19,985 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(3304): Received CLOSE for 77122379f24b212e77917d634d12df04 2023-02-17 22:01:19,985 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-17 22:01:19,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 21f4c91b6f12e0a7c98e7f8c2ca844b0, disabling compactions & flushes 2023-02-17 22:01:19,985 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1479): Online Regions={b8f972b5de712f7adcec23aa37d255c5=testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5., 1f620b5280ca333cec490d0f7011ae1a=testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a., e72f6f91525ad2a00a0aad25e4750df6=testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6., 040160ac83c0dcea7440b1e785990deb=hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb., b34d5c817bbfe966332f6e672d7e76fa=testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa., fa2ed7019381e0d1e1784ad608dbf5cc=testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.} 2023-02-17 22:01:19,985 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(3304): Received CLOSE for 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:19,987 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(3304): Received CLOSE for a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:19,987 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:19,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:19,987 DEBUG [RS:1;jenkins-hbase9:40799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0be808ab to 127.0.0.1:62481 2023-02-17 22:01:19,987 DEBUG [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1505): Waiting on 040160ac83c0dcea7440b1e785990deb, 1f620b5280ca333cec490d0f7011ae1a, b34d5c817bbfe966332f6e672d7e76fa, b8f972b5de712f7adcec23aa37d255c5, e72f6f91525ad2a00a0aad25e4750df6, fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:19,988 DEBUG [RS:1;jenkins-hbase9:40799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:19,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:19,988 INFO [RS:1;jenkins-hbase9:40799] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:19,988 INFO [RS:1;jenkins-hbase9:40799] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:19,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. after waiting 0 ms 2023-02-17 22:01:19,988 INFO [RS:1;jenkins-hbase9:40799] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:19,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:19,988 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:19,989 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-17 22:01:19,989 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1479): Online Regions={21f4c91b6f12e0a7c98e7f8c2ca844b0=testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0., d79bb42e50e0858865e07bb1e742228d=testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d., 1588230740=hbase:meta,,1.1588230740, 77122379f24b212e77917d634d12df04=testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04., 1181fc63c2835ef1ddd4d20b45eeaa7c=testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c., a3f95e6118883152eff6745a0de70c99=testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.} 2023-02-17 22:01:19,989 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:19,990 DEBUG [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1505): Waiting on 1181fc63c2835ef1ddd4d20b45eeaa7c, 1588230740, 21f4c91b6f12e0a7c98e7f8c2ca844b0, 77122379f24b212e77917d634d12df04, a3f95e6118883152eff6745a0de70c99, d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:19,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:19,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:19,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:19,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:19,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-17 22:01:20,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:20,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1f620b5280ca333cec490d0f7011ae1a, disabling compactions & flushes 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d79bb42e50e0858865e07bb1e742228d, disabling compactions & flushes 2023-02-17 22:01:20,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. after waiting 0 ms 2023-02-17 22:01:20,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. after waiting 0 ms 2023-02-17 22:01:20,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,015 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:20,015 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:20,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 22:01:20,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:20,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 77122379f24b212e77917d634d12df04, disabling compactions & flushes 2023-02-17 22:01:20,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. after waiting 0 ms 2023-02-17 22:01:20,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/.tmp/info/b7c5d91887b84f058597a8491f9eae7b 2023-02-17 22:01:20,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:20,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e72f6f91525ad2a00a0aad25e4750df6, disabling compactions & flushes 2023-02-17 22:01:20,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. after waiting 0 ms 2023-02-17 22:01:20,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 040160ac83c0dcea7440b1e785990deb, disabling compactions & flushes 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1181fc63c2835ef1ddd4d20b45eeaa7c, disabling compactions & flushes 2023-02-17 22:01:20,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:20,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:20,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. after waiting 0 ms 2023-02-17 22:01:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. after waiting 0 ms 2023-02-17 22:01:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:20,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 040160ac83c0dcea7440b1e785990deb 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:20,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/.tmp/table/96e8f63326554994bbc9734f36557cac 2023-02-17 22:01:20,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:20,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a3f95e6118883152eff6745a0de70c99, disabling compactions & flushes 2023-02-17 22:01:20,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. after waiting 0 ms 2023-02-17 22:01:20,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/.tmp/info/b7c5d91887b84f058597a8491f9eae7b as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/info/b7c5d91887b84f058597a8491f9eae7b 2023-02-17 22:01:20,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/.tmp/info/fe2a24085d804164aa7debe5faf2095f 2023-02-17 22:01:20,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,075 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/info/b7c5d91887b84f058597a8491f9eae7b, entries=110, sequenceid=32, filesize=18.7 K 2023-02-17 22:01:20,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:20,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,076 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/.tmp/table/96e8f63326554994bbc9734f36557cac as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/table/96e8f63326554994bbc9734f36557cac 2023-02-17 22:01:20,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/.tmp/info/fe2a24085d804164aa7debe5faf2095f as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/info/fe2a24085d804164aa7debe5faf2095f 2023-02-17 22:01:20,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/table/96e8f63326554994bbc9734f36557cac, entries=4, sequenceid=32, filesize=4.8 K 2023-02-17 22:01:20,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 92ms, sequenceid=32, compaction requested=false 2023-02-17 22:01:20,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-17 22:01:20,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/info/fe2a24085d804164aa7debe5faf2095f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:20,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 040160ac83c0dcea7440b1e785990deb in 43ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:20,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-17 22:01:20,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-17 22:01:20,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:20,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:20,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:20,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:20,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/hbase/namespace/040160ac83c0dcea7440b1e785990deb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:20,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 040160ac83c0dcea7440b1e785990deb: 2023-02-17 22:01:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671275184.040160ac83c0dcea7440b1e785990deb. 2023-02-17 22:01:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing b34d5c817bbfe966332f6e672d7e76fa, disabling compactions & flushes 2023-02-17 22:01:20,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. after waiting 0 ms 2023-02-17 22:01:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 22:01:20,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:20,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing fa2ed7019381e0d1e1784ad608dbf5cc, disabling compactions & flushes 2023-02-17 22:01:20,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. after waiting 0 ms 2023-02-17 22:01:20,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:20,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:20,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,188 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41709,1676671274520; all regions closed. 2023-02-17 22:01:20,192 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,40799,1676671274553; all regions closed. 2023-02-17 22:01:20,199 DEBUG [RS:0;jenkins-hbase9:41709] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/oldWALs 2023-02-17 22:01:20,199 DEBUG [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/oldWALs 2023-02-17 22:01:20,199 INFO [RS:0;jenkins-hbase9:41709] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41709%2C1676671274520:(num 1676671275562) 2023-02-17 22:01:20,199 DEBUG [RS:0;jenkins-hbase9:41709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:20,199 INFO [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40799%2C1676671274553.meta:.meta(num 1676671275113) 2023-02-17 22:01:20,199 INFO [RS:0;jenkins-hbase9:41709] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:20,200 INFO [RS:0;jenkins-hbase9:41709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:20,200 INFO [RS:0;jenkins-hbase9:41709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:20,200 INFO [RS:0;jenkins-hbase9:41709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:20,200 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:20,200 INFO [RS:0;jenkins-hbase9:41709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:20,202 INFO [RS:0;jenkins-hbase9:41709] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41709 2023-02-17 22:01:20,208 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:20,208 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26f72f96 rejected from java.util.concurrent.ThreadPoolExecutor@22c8bf90[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,208 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:20,208 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41709,1676671274520 2023-02-17 22:01:20,209 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:20,208 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/WALs/jenkins-hbase9.apache.org,40799,1676671274553/jenkins-hbase9.apache.org%2C40799%2C1676671274553.1676671275915 not finished, retry = 0 2023-02-17 22:01:20,208 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:20,208 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49f37a60 rejected from java.util.concurrent.ThreadPoolExecutor@22c8bf90[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,211 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41709,1676671274520] 2023-02-17 22:01:20,211 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41709,1676671274520; numProcessing=1 2023-02-17 22:01:20,213 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41709,1676671274520 already deleted, retry=false 2023-02-17 22:01:20,213 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41709,1676671274520 expired; onlineServers=1 2023-02-17 22:01:20,311 DEBUG [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/oldWALs 2023-02-17 22:01:20,311 INFO [RS:1;jenkins-hbase9:40799] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40799%2C1676671274553:(num 1676671275915) 2023-02-17 22:01:20,311 DEBUG [RS:1;jenkins-hbase9:40799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:20,311 INFO [RS:1;jenkins-hbase9:40799] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:20,311 INFO [RS:1;jenkins-hbase9:40799] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:20,311 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:20,312 INFO [RS:1;jenkins-hbase9:40799] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:40799 2023-02-17 22:01:20,315 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:20,315 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40799,1676671274553 2023-02-17 22:01:20,315 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73502c6b rejected from java.util.concurrent.ThreadPoolExecutor@776fb6d9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,316 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,40799,1676671274553] 2023-02-17 22:01:20,316 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,40799,1676671274553; numProcessing=2 2023-02-17 22:01:20,318 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,40799,1676671274553 already deleted, retry=false 2023-02-17 22:01:20,318 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,40799,1676671274553 expired; onlineServers=0 2023-02-17 22:01:20,318 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45227,1676671274467' ***** 2023-02-17 22:01:20,318 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:20,319 DEBUG [M:0;jenkins-hbase9:45227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a78f925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:20,319 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45227,1676671274467 2023-02-17 22:01:20,319 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45227,1676671274467; all regions closed. 2023-02-17 22:01:20,319 DEBUG [M:0;jenkins-hbase9:45227] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:20,319 DEBUG [M:0;jenkins-hbase9:45227] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:20,319 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:20,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671274737] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671274737,5,FailOnTimeoutGroup] 2023-02-17 22:01:20,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671274737] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671274737,5,FailOnTimeoutGroup] 2023-02-17 22:01:20,319 DEBUG [M:0;jenkins-hbase9:45227] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:20,321 INFO [M:0;jenkins-hbase9:45227] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:20,321 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:20,321 INFO [M:0;jenkins-hbase9:45227] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:20,321 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:20,322 INFO [M:0;jenkins-hbase9:45227] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:20,322 DEBUG [M:0;jenkins-hbase9:45227] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:20,322 INFO [M:0;jenkins-hbase9:45227] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:20,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:20,322 ERROR [M:0;jenkins-hbase9:45227] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 22:01:20,322 INFO [M:0;jenkins-hbase9:45227] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:20,322 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:20,323 DEBUG [M:0;jenkins-hbase9:45227] zookeeper.ZKUtil(398): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:20,323 WARN [M:0;jenkins-hbase9:45227] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:20,323 INFO [M:0;jenkins-hbase9:45227] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:20,323 INFO [M:0;jenkins-hbase9:45227] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:20,323 DEBUG [M:0;jenkins-hbase9:45227] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:20,323 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:20,323 DEBUG [M:0;jenkins-hbase9:45227] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:20,323 DEBUG [M:0;jenkins-hbase9:45227] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:20,324 DEBUG [M:0;jenkins-hbase9:45227] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:20,324 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-17 22:01:20,332 INFO [M:0;jenkins-hbase9:45227] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c8cb71475234047a4cb3c7257bbc6c5 2023-02-17 22:01:20,337 DEBUG [M:0;jenkins-hbase9:45227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c8cb71475234047a4cb3c7257bbc6c5 as hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c8cb71475234047a4cb3c7257bbc6c5 2023-02-17 22:01:20,342 INFO [M:0;jenkins-hbase9:45227] regionserver.HStore(1080): Added hdfs://localhost:33889/user/jenkins/test-data/4644efec-c75d-de0e-1672-b05cc4d80c91/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c8cb71475234047a4cb3c7257bbc6c5, entries=31, sequenceid=218, filesize=9.0 K 2023-02-17 22:01:20,342 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=218, compaction requested=false 2023-02-17 22:01:20,343 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:20,343 DEBUG [M:0;jenkins-hbase9:45227] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:20,346 INFO [M:0;jenkins-hbase9:45227] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:20,346 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:20,347 INFO [M:0;jenkins-hbase9:45227] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45227 2023-02-17 22:01:20,355 DEBUG [M:0;jenkins-hbase9:45227] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,45227,1676671274467 already deleted, retry=false 2023-02-17 22:01:20,480 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:20,480 INFO [M:0;jenkins-hbase9:45227] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45227,1676671274467; zookeeper connection closed. 2023-02-17 22:01:20,480 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29ed10cb rejected from java.util.concurrent.ThreadPoolExecutor@2dd2812e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,481 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): master:45227-0x100644e2dbb0000, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:20,481 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18d865ae rejected from java.util.concurrent.ThreadPoolExecutor@2dd2812e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,580 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:20,580 INFO [RS:1;jenkins-hbase9:40799] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,40799,1676671274553; zookeeper connection closed. 2023-02-17 22:01:20,580 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71d4df21 rejected from java.util.concurrent.ThreadPoolExecutor@776fb6d9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,580 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18d054f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18d054f 2023-02-17 22:01:20,580 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:40799-0x100644e2dbb0002, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:20,580 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@9c631d1 rejected from java.util.concurrent.ThreadPoolExecutor@776fb6d9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,680 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:20,680 INFO [RS:0;jenkins-hbase9:41709] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41709,1676671274520; zookeeper connection closed. 2023-02-17 22:01:20,680 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31b46634 rejected from java.util.concurrent.ThreadPoolExecutor@22c8bf90[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,681 DEBUG [Listener at localhost/43847-EventThread] zookeeper.ZKWatcher(600): regionserver:41709-0x100644e2dbb0001, quorum=127.0.0.1:62481, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:20,681 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@583bf597] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@583bf597 2023-02-17 22:01:20,681 ERROR [Listener at localhost/43847-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55178004 rejected from java.util.concurrent.ThreadPoolExecutor@22c8bf90[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:20,681 INFO [Listener at localhost/43847] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:20,779 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop-1061900761478550017.jar 2023-02-17 22:01:20,784 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676671276670 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:20,784 DEBUG [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: 77122379f24b212e77917d634d12df04 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(239): region to add: a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=b8f972b5de712f7adcec23aa37d255c5 as b8f972b5de712f7adcec23aa37d255c5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=1f620b5280ca333cec490d0f7011ae1a as 1f620b5280ca333cec490d0f7011ae1a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=e72f6f91525ad2a00a0aad25e4750df6 as e72f6f91525ad2a00a0aad25e4750df6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=21f4c91b6f12e0a7c98e7f8c2ca844b0 as 21f4c91b6f12e0a7c98e7f8c2ca844b0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,787 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=d79bb42e50e0858865e07bb1e742228d as d79bb42e50e0858865e07bb1e742228d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,788 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=b34d5c817bbfe966332f6e672d7e76fa as b34d5c817bbfe966332f6e672d7e76fa in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,788 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=77122379f24b212e77917d634d12df04 as 77122379f24b212e77917d634d12df04 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,788 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=fa2ed7019381e0d1e1784ad608dbf5cc as fa2ed7019381e0d1e1784ad608dbf5cc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,788 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=1181fc63c2835ef1ddd4d20b45eeaa7c as 1181fc63c2835ef1ddd4d20b45eeaa7c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,788 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(585): clone region=a3f95e6118883152eff6745a0de70c99 as a3f95e6118883152eff6745a0de70c99 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 22:01:20,789 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d79bb42e50e0858865e07bb1e742228d, NAME => 'testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,790 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e72f6f91525ad2a00a0aad25e4750df6, NAME => 'testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,790 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1f620b5280ca333cec490d0f7011ae1a, NAME => 'testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,790 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 21f4c91b6f12e0a7c98e7f8c2ca844b0, NAME => 'testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,790 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b8f972b5de712f7adcec23aa37d255c5, NAME => 'testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,790 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => b34d5c817bbfe966332f6e672d7e76fa, NAME => 'testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,792 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 77122379f24b212e77917d634d12df04, NAME => 'testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,801 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => fa2ed7019381e0d1e1784ad608dbf5cc, NAME => 'testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,810 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,810 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d79bb42e50e0858865e07bb1e742228d, disabling compactions & flushes 2023-02-17 22:01:20,810 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,810 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,810 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. after waiting 0 ms 2023-02-17 22:01:20,811 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,811 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:20,811 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,811 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,811 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59e57331634b46e1b55a0342bea1d5a3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,811 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc4b094961aa4a4abbf3f573a04823ff from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,811 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:20,812 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 1181fc63c2835ef1ddd4d20b45eeaa7c, NAME => 'testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,820 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,820 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 82326f8a310a46f0bcaa300b4038c5b6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,820 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eb569764081e4d9598935c77a56ac0cd from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,820 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,820 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c2dc4fc6fae54239b7f1d82049cec603 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,820 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,820 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing b34d5c817bbfe966332f6e672d7e76fa, disabling compactions & flushes 2023-02-17 22:01:20,820 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,820 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,820 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. after waiting 0 ms 2023-02-17 22:01:20,821 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,821 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:20,821 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:20,821 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => a3f95e6118883152eff6745a0de70c99, NAME => 'testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,828 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2544c4a2398c42c09685a5887e9a02b7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,828 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8f49a8f72cb04e4da314cbce929a6c12 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,829 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3f6330cbe71e4ce486a9ccbdf76ae81e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,830 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e72f6f91525ad2a00a0aad25e4750df6, disabling compactions & flushes 2023-02-17 22:01:20,830 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,830 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,830 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. after waiting 0 ms 2023-02-17 22:01:20,830 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,830 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:20,830 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:20,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b8f972b5de712f7adcec23aa37d255c5, disabling compactions & flushes 2023-02-17 22:01:20,831 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:20,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:20,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. after waiting 0 ms 2023-02-17 22:01:20,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:20,831 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:20,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:20,842 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,842 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9bf718bb7b324494b1d9a6193ec16097 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 21f4c91b6f12e0a7c98e7f8c2ca844b0, disabling compactions & flushes 2023-02-17 22:01:20,847 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. after waiting 0 ms 2023-02-17 22:01:20,847 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33d6504202c74894b4d6d43977ec8754 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:20,847 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 77122379f24b212e77917d634d12df04, disabling compactions & flushes 2023-02-17 22:01:20,847 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. after waiting 0 ms 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,847 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:20,847 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:20,851 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,851 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a606953e089441efa8e5c12e39d48dc3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,852 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dc08ddb323ea496bb405b280d21ee763 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,853 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35c326b91e19446d8b3a99847423b20b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,854 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:20,854 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 83a0f598e38a49c0b38061a56a7dd86f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,855 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 1f620b5280ca333cec490d0f7011ae1a, disabling compactions & flushes 2023-02-17 22:01:20,855 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,855 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,855 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. after waiting 0 ms 2023-02-17 22:01:20,855 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b6bcac13a7cb4ca2a6bbfd3033d71511 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,855 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,855 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:20,855 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:20,856 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 1181fc63c2835ef1ddd4d20b45eeaa7c, disabling compactions & flushes 2023-02-17 22:01:20,856 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,856 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,856 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. after waiting 0 ms 2023-02-17 22:01:20,856 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,856 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:20,856 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:20,857 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 92f99468720f455ead045c2263b1b8fa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 22:01:20,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing fa2ed7019381e0d1e1784ad608dbf5cc, disabling compactions & flushes 2023-02-17 22:01:20,857 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. after waiting 0 ms 2023-02-17 22:01:20,858 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,858 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:20,858 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:20,859 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing a3f95e6118883152eff6745a0de70c99, disabling compactions & flushes 2023-02-17 22:01:20,859 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,859 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,859 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. after waiting 0 ms 2023-02-17 22:01:20,859 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,859 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:20,859 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:20,860 INFO [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676671276670 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:20,860 DEBUG [Listener at localhost/43847] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,860 DEBUG [Listener at localhost/43847] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8 2023-02-17 22:01:20,861 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:20,861 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:20,862 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 22:01:20,862 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------1181fc63c2835ef1ddd4d20b45eeaa7c/ 2023-02-17 22:01:20,863 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,863 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,863 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=1181fc63c2835ef1ddd4d20b45eeaa7c-9bf718bb7b324494b1d9a6193ec16097 2023-02-17 22:01:20,863 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,864 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=1181fc63c2835ef1ddd4d20b45eeaa7c-35c326b91e19446d8b3a99847423b20b 2023-02-17 22:01:20,864 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------1f620b5280ca333cec490d0f7011ae1a/ 2023-02-17 22:01:20,864 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,864 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,865 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=1f620b5280ca333cec490d0f7011ae1a-33d6504202c74894b4d6d43977ec8754 2023-02-17 22:01:20,865 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,865 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=1f620b5280ca333cec490d0f7011ae1a-dc08ddb323ea496bb405b280d21ee763 2023-02-17 22:01:20,865 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------21f4c91b6f12e0a7c98e7f8c2ca844b0/ 2023-02-17 22:01:20,866 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,866 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,866 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=21f4c91b6f12e0a7c98e7f8c2ca844b0-c2dc4fc6fae54239b7f1d82049cec603 2023-02-17 22:01:20,866 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,867 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=21f4c91b6f12e0a7c98e7f8c2ca844b0-8f49a8f72cb04e4da314cbce929a6c12 2023-02-17 22:01:20,867 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------77122379f24b212e77917d634d12df04/ 2023-02-17 22:01:20,867 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,867 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,868 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=77122379f24b212e77917d634d12df04-eb569764081e4d9598935c77a56ac0cd 2023-02-17 22:01:20,868 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,868 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=77122379f24b212e77917d634d12df04-3f6330cbe71e4ce486a9ccbdf76ae81e 2023-02-17 22:01:20,868 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------a3f95e6118883152eff6745a0de70c99/ 2023-02-17 22:01:20,869 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,869 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,870 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=a3f95e6118883152eff6745a0de70c99-83a0f598e38a49c0b38061a56a7dd86f 2023-02-17 22:01:20,870 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,871 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=a3f95e6118883152eff6745a0de70c99-92f99468720f455ead045c2263b1b8fa 2023-02-17 22:01:20,871 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------b34d5c817bbfe966332f6e672d7e76fa/ 2023-02-17 22:01:20,871 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,871 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------b8f972b5de712f7adcec23aa37d255c5/ 2023-02-17 22:01:20,872 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,872 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,872 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=b8f972b5de712f7adcec23aa37d255c5-bc4b094961aa4a4abbf3f573a04823ff 2023-02-17 22:01:20,872 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,873 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=b8f972b5de712f7adcec23aa37d255c5-2544c4a2398c42c09685a5887e9a02b7 2023-02-17 22:01:20,873 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------d79bb42e50e0858865e07bb1e742228d/ 2023-02-17 22:01:20,873 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,873 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------e72f6f91525ad2a00a0aad25e4750df6/ 2023-02-17 22:01:20,873 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,874 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,874 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=e72f6f91525ad2a00a0aad25e4750df6-59e57331634b46e1b55a0342bea1d5a3 2023-02-17 22:01:20,874 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,874 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=e72f6f91525ad2a00a0aad25e4750df6-82326f8a310a46f0bcaa300b4038c5b6 2023-02-17 22:01:20,874 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |----------fa2ed7019381e0d1e1784ad608dbf5cc/ 2023-02-17 22:01:20,875 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:20,875 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:20,875 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=fa2ed7019381e0d1e1784ad608dbf5cc-a606953e089441efa8e5c12e39d48dc3 2023-02-17 22:01:20,875 DEBUG [Listener at localhost/43847] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:20,876 DEBUG [Listener at localhost/43847] util.CommonFSUtils(702): |----------------testWithMapReduce=fa2ed7019381e0d1e1784ad608dbf5cc-b6bcac13a7cb4ca2a6bbfd3033d71511 2023-02-17 22:01:20,876 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:20,877 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:20,877 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:20,877 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,774 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop-3329551339803829207.jar 2023-02-17 22:01:21,774 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,775 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,847 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop-1414397912298908958.jar 2023-02-17 22:01:21,848 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,848 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,849 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,849 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,850 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,850 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,851 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 22:01:21,851 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 22:01:21,852 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 22:01:21,852 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 22:01:21,853 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 22:01:21,853 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 22:01:21,854 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 22:01:21,854 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 22:01:21,854 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 22:01:21,855 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 22:01:21,855 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:21,856 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:21,856 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:21,857 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:21,857 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 22:01:21,933 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop-9126154490639026043.jar 2023-02-17 22:01:21,934 DEBUG [Listener at localhost/43847] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 22:01:21,939 WARN [Listener at localhost/43847] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 22:01:21,945 WARN [Listener at localhost/43847] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-17 22:01:21,952 INFO [Listener at localhost/43847] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 22:01:22,050 WARN [Listener at localhost/43847] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/mapreduce.cluster.local.dir/1676671282019/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 22:01:22,050 WARN [Listener at localhost/43847] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/mapreduce.cluster.local.dir/1676671282019/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 22:01:22,085 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,085 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,095 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,097 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:22,098 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1 2023-02-17 22:01:22,098 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1181fc63c2835ef1ddd4d20b45eeaa7c columnFamilyName f1 2023-02-17 22:01:22,103 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f1/testWithMapReduce=1181fc63c2835ef1ddd4d20b45eeaa7c-9bf718bb7b324494b1d9a6193ec16097 2023-02-17 22:01:22,103 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(310): Store=1181fc63c2835ef1ddd4d20b45eeaa7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,103 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1181fc63c2835ef1ddd4d20b45eeaa7c 2023-02-17 22:01:22,104 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2 2023-02-17 22:01:22,104 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1181fc63c2835ef1ddd4d20b45eeaa7c columnFamilyName f2 2023-02-17 22:01:22,109 DEBUG [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1181fc63c2835ef1ddd4d20b45eeaa7c/f2/testWithMapReduce=1181fc63c2835ef1ddd4d20b45eeaa7c-35c326b91e19446d8b3a99847423b20b 2023-02-17 22:01:22,109 INFO [StoreOpener-1181fc63c2835ef1ddd4d20b45eeaa7c-1] regionserver.HStore(310): Store=1181fc63c2835ef1ddd4d20b45eeaa7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,110 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1181fc63c2835ef1ddd4d20b45eeaa7c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62108891, jitterRate=-0.07450540363788605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:22,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1181fc63c2835ef1ddd4d20b45eeaa7c, disabling compactions & flushes 2023-02-17 22:01:22,142 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:22,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:22,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. after waiting 0 ms 2023-02-17 22:01:22,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:22,143 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676671275895.1181fc63c2835ef1ddd4d20b45eeaa7c. 2023-02-17 22:01:22,143 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1181fc63c2835ef1ddd4d20b45eeaa7c: 2023-02-17 22:01:22,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,146 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,147 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,151 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:22,152 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1 2023-02-17 22:01:22,152 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8f972b5de712f7adcec23aa37d255c5 columnFamilyName f1 2023-02-17 22:01:22,157 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f1/testWithMapReduce=b8f972b5de712f7adcec23aa37d255c5-bc4b094961aa4a4abbf3f573a04823ff 2023-02-17 22:01:22,157 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(310): Store=b8f972b5de712f7adcec23aa37d255c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,157 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b8f972b5de712f7adcec23aa37d255c5 2023-02-17 22:01:22,158 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2 2023-02-17 22:01:22,158 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8f972b5de712f7adcec23aa37d255c5 columnFamilyName f2 2023-02-17 22:01:22,163 DEBUG [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/b8f972b5de712f7adcec23aa37d255c5/f2/testWithMapReduce=b8f972b5de712f7adcec23aa37d255c5-2544c4a2398c42c09685a5887e9a02b7 2023-02-17 22:01:22,163 INFO [StoreOpener-b8f972b5de712f7adcec23aa37d255c5-1] regionserver.HStore(310): Store=b8f972b5de712f7adcec23aa37d255c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,163 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b8f972b5de712f7adcec23aa37d255c5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62251294, jitterRate=-0.07238343358039856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:22,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b8f972b5de712f7adcec23aa37d255c5, disabling compactions & flushes 2023-02-17 22:01:22,191 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:22,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:22,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. after waiting 0 ms 2023-02-17 22:01:22,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:22,192 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676671275895.b8f972b5de712f7adcec23aa37d255c5. 2023-02-17 22:01:22,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b8f972b5de712f7adcec23aa37d255c5: 2023-02-17 22:01:22,195 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,195 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,196 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,198 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:22,199 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1 2023-02-17 22:01:22,199 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f4c91b6f12e0a7c98e7f8c2ca844b0 columnFamilyName f1 2023-02-17 22:01:22,204 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f1/testWithMapReduce=21f4c91b6f12e0a7c98e7f8c2ca844b0-c2dc4fc6fae54239b7f1d82049cec603 2023-02-17 22:01:22,204 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(310): Store=21f4c91b6f12e0a7c98e7f8c2ca844b0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,204 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21f4c91b6f12e0a7c98e7f8c2ca844b0 2023-02-17 22:01:22,205 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2 2023-02-17 22:01:22,206 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f4c91b6f12e0a7c98e7f8c2ca844b0 columnFamilyName f2 2023-02-17 22:01:22,210 DEBUG [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/21f4c91b6f12e0a7c98e7f8c2ca844b0/f2/testWithMapReduce=21f4c91b6f12e0a7c98e7f8c2ca844b0-8f49a8f72cb04e4da314cbce929a6c12 2023-02-17 22:01:22,210 INFO [StoreOpener-21f4c91b6f12e0a7c98e7f8c2ca844b0-1] regionserver.HStore(310): Store=21f4c91b6f12e0a7c98e7f8c2ca844b0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,210 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,210 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 21f4c91b6f12e0a7c98e7f8c2ca844b0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72770535, jitterRate=0.08436547219753265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,210 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:22,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 21f4c91b6f12e0a7c98e7f8c2ca844b0, disabling compactions & flushes 2023-02-17 22:01:22,255 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:22,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:22,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. after waiting 0 ms 2023-02-17 22:01:22,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:22,256 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676671275895.21f4c91b6f12e0a7c98e7f8c2ca844b0. 2023-02-17 22:01:22,256 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 21f4c91b6f12e0a7c98e7f8c2ca844b0: 2023-02-17 22:01:22,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,259 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,263 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,265 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:22,266 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1 2023-02-17 22:01:22,266 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3f95e6118883152eff6745a0de70c99 columnFamilyName f1 2023-02-17 22:01:22,272 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f1/testWithMapReduce=a3f95e6118883152eff6745a0de70c99-83a0f598e38a49c0b38061a56a7dd86f 2023-02-17 22:01:22,272 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(310): Store=a3f95e6118883152eff6745a0de70c99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,272 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3f95e6118883152eff6745a0de70c99 2023-02-17 22:01:22,273 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2 2023-02-17 22:01:22,273 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3f95e6118883152eff6745a0de70c99 columnFamilyName f2 2023-02-17 22:01:22,278 DEBUG [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/a3f95e6118883152eff6745a0de70c99/f2/testWithMapReduce=a3f95e6118883152eff6745a0de70c99-92f99468720f455ead045c2263b1b8fa 2023-02-17 22:01:22,279 INFO [StoreOpener-a3f95e6118883152eff6745a0de70c99-1] regionserver.HStore(310): Store=a3f95e6118883152eff6745a0de70c99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,279 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a3f95e6118883152eff6745a0de70c99; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75018095, jitterRate=0.11785672605037689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:22,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a3f95e6118883152eff6745a0de70c99, disabling compactions & flushes 2023-02-17 22:01:22,312 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:22,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:22,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. after waiting 0 ms 2023-02-17 22:01:22,312 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:22,313 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676671275895.a3f95e6118883152eff6745a0de70c99. 2023-02-17 22:01:22,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a3f95e6118883152eff6745a0de70c99: 2023-02-17 22:01:22,317 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,317 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,318 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,320 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:22,321 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1 2023-02-17 22:01:22,321 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f620b5280ca333cec490d0f7011ae1a columnFamilyName f1 2023-02-17 22:01:22,326 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f1/testWithMapReduce=1f620b5280ca333cec490d0f7011ae1a-33d6504202c74894b4d6d43977ec8754 2023-02-17 22:01:22,327 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(310): Store=1f620b5280ca333cec490d0f7011ae1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,327 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1f620b5280ca333cec490d0f7011ae1a 2023-02-17 22:01:22,328 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2 2023-02-17 22:01:22,328 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f620b5280ca333cec490d0f7011ae1a columnFamilyName f2 2023-02-17 22:01:22,332 DEBUG [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/1f620b5280ca333cec490d0f7011ae1a/f2/testWithMapReduce=1f620b5280ca333cec490d0f7011ae1a-dc08ddb323ea496bb405b280d21ee763 2023-02-17 22:01:22,332 INFO [StoreOpener-1f620b5280ca333cec490d0f7011ae1a-1] regionserver.HStore(310): Store=1f620b5280ca333cec490d0f7011ae1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,333 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1f620b5280ca333cec490d0f7011ae1a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73838458, jitterRate=0.10027876496315002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:22,359 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1f620b5280ca333cec490d0f7011ae1a, disabling compactions & flushes 2023-02-17 22:01:22,360 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:22,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:22,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. after waiting 0 ms 2023-02-17 22:01:22,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:22,360 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676671275895.1f620b5280ca333cec490d0f7011ae1a. 2023-02-17 22:01:22,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1f620b5280ca333cec490d0f7011ae1a: 2023-02-17 22:01:22,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,364 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,365 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,367 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:22,368 DEBUG [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/f1 2023-02-17 22:01:22,368 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b34d5c817bbfe966332f6e672d7e76fa columnFamilyName f1 2023-02-17 22:01:22,369 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(310): Store=b34d5c817bbfe966332f6e672d7e76fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,369 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b34d5c817bbfe966332f6e672d7e76fa 2023-02-17 22:01:22,370 DEBUG [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/b34d5c817bbfe966332f6e672d7e76fa/f2 2023-02-17 22:01:22,370 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b34d5c817bbfe966332f6e672d7e76fa columnFamilyName f2 2023-02-17 22:01:22,371 INFO [StoreOpener-b34d5c817bbfe966332f6e672d7e76fa-1] regionserver.HStore(310): Store=b34d5c817bbfe966332f6e672d7e76fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,371 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b34d5c817bbfe966332f6e672d7e76fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74404930, jitterRate=0.1087198555469513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,371 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:22,389 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b34d5c817bbfe966332f6e672d7e76fa, disabling compactions & flushes 2023-02-17 22:01:22,389 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:22,389 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:22,389 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. after waiting 0 ms 2023-02-17 22:01:22,389 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:22,390 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676671275895.b34d5c817bbfe966332f6e672d7e76fa. 2023-02-17 22:01:22,390 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b34d5c817bbfe966332f6e672d7e76fa: 2023-02-17 22:01:22,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,392 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,393 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,395 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:22,396 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1 2023-02-17 22:01:22,396 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e72f6f91525ad2a00a0aad25e4750df6 columnFamilyName f1 2023-02-17 22:01:22,401 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f1/testWithMapReduce=e72f6f91525ad2a00a0aad25e4750df6-59e57331634b46e1b55a0342bea1d5a3 2023-02-17 22:01:22,401 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(310): Store=e72f6f91525ad2a00a0aad25e4750df6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,401 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e72f6f91525ad2a00a0aad25e4750df6 2023-02-17 22:01:22,402 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2 2023-02-17 22:01:22,402 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e72f6f91525ad2a00a0aad25e4750df6 columnFamilyName f2 2023-02-17 22:01:22,410 DEBUG [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/e72f6f91525ad2a00a0aad25e4750df6/f2/testWithMapReduce=e72f6f91525ad2a00a0aad25e4750df6-82326f8a310a46f0bcaa300b4038c5b6 2023-02-17 22:01:22,410 INFO [StoreOpener-e72f6f91525ad2a00a0aad25e4750df6-1] regionserver.HStore(310): Store=e72f6f91525ad2a00a0aad25e4750df6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,410 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,411 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e72f6f91525ad2a00a0aad25e4750df6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67302972, jitterRate=0.002892434597015381}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:22,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e72f6f91525ad2a00a0aad25e4750df6, disabling compactions & flushes 2023-02-17 22:01:22,453 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:22,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:22,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. after waiting 0 ms 2023-02-17 22:01:22,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:22,454 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676671275895.e72f6f91525ad2a00a0aad25e4750df6. 2023-02-17 22:01:22,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e72f6f91525ad2a00a0aad25e4750df6: 2023-02-17 22:01:22,457 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,457 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,458 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,460 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:22,461 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1 2023-02-17 22:01:22,462 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa2ed7019381e0d1e1784ad608dbf5cc columnFamilyName f1 2023-02-17 22:01:22,469 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f1/testWithMapReduce=fa2ed7019381e0d1e1784ad608dbf5cc-a606953e089441efa8e5c12e39d48dc3 2023-02-17 22:01:22,469 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(310): Store=fa2ed7019381e0d1e1784ad608dbf5cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,469 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fa2ed7019381e0d1e1784ad608dbf5cc 2023-02-17 22:01:22,471 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2 2023-02-17 22:01:22,471 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa2ed7019381e0d1e1784ad608dbf5cc columnFamilyName f2 2023-02-17 22:01:22,478 DEBUG [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/fa2ed7019381e0d1e1784ad608dbf5cc/f2/testWithMapReduce=fa2ed7019381e0d1e1784ad608dbf5cc-b6bcac13a7cb4ca2a6bbfd3033d71511 2023-02-17 22:01:22,478 INFO [StoreOpener-fa2ed7019381e0d1e1784ad608dbf5cc-1] regionserver.HStore(310): Store=fa2ed7019381e0d1e1784ad608dbf5cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,478 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,479 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fa2ed7019381e0d1e1784ad608dbf5cc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69549487, jitterRate=0.03636811673641205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,479 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:22,505 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fa2ed7019381e0d1e1784ad608dbf5cc, disabling compactions & flushes 2023-02-17 22:01:22,506 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:22,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:22,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. after waiting 0 ms 2023-02-17 22:01:22,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:22,507 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676671275895.fa2ed7019381e0d1e1784ad608dbf5cc. 2023-02-17 22:01:22,507 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fa2ed7019381e0d1e1784ad608dbf5cc: 2023-02-17 22:01:22,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,511 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,513 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,515 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77122379f24b212e77917d634d12df04 2023-02-17 22:01:22,516 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1 2023-02-17 22:01:22,516 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77122379f24b212e77917d634d12df04 columnFamilyName f1 2023-02-17 22:01:22,522 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f1/testWithMapReduce=77122379f24b212e77917d634d12df04-eb569764081e4d9598935c77a56ac0cd 2023-02-17 22:01:22,523 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(310): Store=77122379f24b212e77917d634d12df04/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,523 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77122379f24b212e77917d634d12df04 2023-02-17 22:01:22,524 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2 2023-02-17 22:01:22,524 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77122379f24b212e77917d634d12df04 columnFamilyName f2 2023-02-17 22:01:22,529 DEBUG [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(539): loaded hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/77122379f24b212e77917d634d12df04/f2/testWithMapReduce=77122379f24b212e77917d634d12df04-3f6330cbe71e4ce486a9ccbdf76ae81e 2023-02-17 22:01:22,529 INFO [StoreOpener-77122379f24b212e77917d634d12df04-1] regionserver.HStore(310): Store=77122379f24b212e77917d634d12df04/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,529 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 77122379f24b212e77917d634d12df04; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64029364, jitterRate=-0.04588812589645386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,529 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:22,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 77122379f24b212e77917d634d12df04, disabling compactions & flushes 2023-02-17 22:01:22,558 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:22,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:22,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. after waiting 0 ms 2023-02-17 22:01:22,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:22,559 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676671275895.77122379f24b212e77917d634d12df04. 2023-02-17 22:01:22,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 77122379f24b212e77917d634d12df04: 2023-02-17 22:01:22,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:22,563 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:22,564 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:22,567 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:22,568 DEBUG [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/f1 2023-02-17 22:01:22,569 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d79bb42e50e0858865e07bb1e742228d columnFamilyName f1 2023-02-17 22:01:22,569 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(310): Store=d79bb42e50e0858865e07bb1e742228d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,570 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d79bb42e50e0858865e07bb1e742228d 2023-02-17 22:01:22,572 DEBUG [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33889/user/jenkins/test-data/b6908fea-f9c2-d56e-431b-6c6cc256f101/testWithMapReduceAndOfflineHBaseMultiRegion/bce3523a-bab2-4025-9db0-f1e77d80eda8/data/default/testWithMapReduce/d79bb42e50e0858865e07bb1e742228d/f2 2023-02-17 22:01:22,573 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d79bb42e50e0858865e07bb1e742228d columnFamilyName f2 2023-02-17 22:01:22,573 INFO [StoreOpener-d79bb42e50e0858865e07bb1e742228d-1] regionserver.HStore(310): Store=d79bb42e50e0858865e07bb1e742228d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:22,573 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:22,574 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d79bb42e50e0858865e07bb1e742228d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69659222, jitterRate=0.03800329566001892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:22,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:22,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d79bb42e50e0858865e07bb1e742228d, disabling compactions & flushes 2023-02-17 22:01:22,593 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:22,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:22,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. after waiting 0 ms 2023-02-17 22:01:22,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:22,593 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671275895.d79bb42e50e0858865e07bb1e742228d. 2023-02-17 22:01:22,593 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d79bb42e50e0858865e07bb1e742228d: 2023-02-17 22:01:23,086 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:23,087 WARN [Listener at localhost/43847] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:23,096 INFO [Listener at localhost/43847] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:23,200 WARN [BP-636686024-172.31.2.10-1676671273816 heartbeating to localhost/127.0.0.1:33889] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:23,202 WARN [BP-636686024-172.31.2.10-1676671273816 heartbeating to localhost/127.0.0.1:33889] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-636686024-172.31.2.10-1676671273816 (Datanode Uuid 218a7d91-3da4-476b-8efc-3ed83e7a557a) service to localhost/127.0.0.1:33889 2023-02-17 22:01:23,203 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/dfs/data/data3/current/BP-636686024-172.31.2.10-1676671273816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:23,203 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/dfs/data/data4/current/BP-636686024-172.31.2.10-1676671273816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:23,204 WARN [Listener at localhost/43847] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:23,207 INFO [Listener at localhost/43847] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:23,306 WARN [BP-636686024-172.31.2.10-1676671273816 heartbeating to localhost/127.0.0.1:33889] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-636686024-172.31.2.10-1676671273816 (Datanode Uuid 96971ca9-33af-4616-96ab-c145c9eceb9d) service to localhost/127.0.0.1:33889 2023-02-17 22:01:23,307 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/dfs/data/data1/current/BP-636686024-172.31.2.10-1676671273816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:23,308 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/cluster_6bbde6f4-200a-363e-c599-9d8f034eb729/dfs/data/data2/current/BP-636686024-172.31.2.10-1676671273816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:23,322 INFO [Listener at localhost/43847] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:23,442 INFO [Listener at localhost/43847] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:23,494 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:23,513 INFO [Listener at localhost/43847] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 103) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33889 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43847 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:33889 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:33889 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33889 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33889 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33889 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,45227,1676671274467)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=535 (was 543), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 337), ProcessCount=173 (was 173), AvailableMemoryMB=6916 (was 7612) 2023-02-17 22:01:23,524 INFO [Listener at localhost/43847] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=173, AvailableMemoryMB=6915 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop.log.dir so I do NOT create it in target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890 2023-02-17 22:01:23,536 WARN [Listener at localhost/43847] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop.tmp.dir so I do NOT create it in target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890 2023-02-17 22:01:23,536 WARN [Listener at localhost/43847] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5287edf9-a59a-5200-84c9-6eed913cbe60/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 22:01:23,536 DEBUG [Listener at localhost/43847] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6, deleteOnExit=true 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/test.cache.data in system properties and HBase conf 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:01:23,536 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:01:23,537 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:01:23,537 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:01:23,537 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:01:23,537 DEBUG [Listener at localhost/43847] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:01:23,537 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:23,537 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:23,538 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:01:23,538 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:23,538 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:01:23,538 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:01:23,538 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:23,538 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:23,539 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:01:23,539 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:01:23,539 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:01:23,539 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:23,540 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:01:23,540 INFO [Listener at localhost/43847] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:01:23,544 WARN [Listener at localhost/43847] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:23,544 WARN [Listener at localhost/43847] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:23,612 WARN [Listener at localhost/43847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:23,614 INFO [Listener at localhost/43847] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:23,623 INFO [Listener at localhost/43847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/java.io.tmpdir/Jetty_localhost_40553_hdfs____34o6rl/webapp 2023-02-17 22:01:23,718 INFO [Listener at localhost/43847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40553 2023-02-17 22:01:23,723 WARN [Listener at localhost/43847] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:23,723 WARN [Listener at localhost/43847] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:23,771 WARN [Listener at localhost/34849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:23,780 WARN [Listener at localhost/34849] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:23,782 WARN [Listener at localhost/34849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:23,783 INFO [Listener at localhost/34849] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:23,789 INFO [Listener at localhost/34849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/java.io.tmpdir/Jetty_localhost_39983_datanode____.dbg8cr/webapp 2023-02-17 22:01:23,882 INFO [Listener at localhost/34849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39983 2023-02-17 22:01:23,890 WARN [Listener at localhost/34335] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:23,901 WARN [Listener at localhost/34335] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:23,903 WARN [Listener at localhost/34335] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:23,904 INFO [Listener at localhost/34335] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:23,909 INFO [Listener at localhost/34335] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/java.io.tmpdir/Jetty_localhost_43537_datanode____.hlygm7/webapp 2023-02-17 22:01:23,996 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6efcbdc24bcdeac9: Processing first storage report for DS-51eafed2-f20b-4649-ae43-b7a45969bc37 from datanode 55dfa2fd-d9b7-4acc-8d09-8f29ac3c6fa0 2023-02-17 22:01:23,996 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6efcbdc24bcdeac9: from storage DS-51eafed2-f20b-4649-ae43-b7a45969bc37 node DatanodeRegistration(127.0.0.1:39427, datanodeUuid=55dfa2fd-d9b7-4acc-8d09-8f29ac3c6fa0, infoPort=44703, infoSecurePort=0, ipcPort=34335, storageInfo=lv=-57;cid=testClusterID;nsid=1358204291;c=1676671283547), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:23,996 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6efcbdc24bcdeac9: Processing first storage report for DS-7540fe9b-1d7b-4746-9163-df841b733118 from datanode 55dfa2fd-d9b7-4acc-8d09-8f29ac3c6fa0 2023-02-17 22:01:23,996 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6efcbdc24bcdeac9: from storage DS-7540fe9b-1d7b-4746-9163-df841b733118 node DatanodeRegistration(127.0.0.1:39427, datanodeUuid=55dfa2fd-d9b7-4acc-8d09-8f29ac3c6fa0, infoPort=44703, infoSecurePort=0, ipcPort=34335, storageInfo=lv=-57;cid=testClusterID;nsid=1358204291;c=1676671283547), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:24,009 INFO [Listener at localhost/34335] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43537 2023-02-17 22:01:24,021 WARN [Listener at localhost/34935] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:24,121 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47511da1a9a1c19c: Processing first storage report for DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c from datanode 0ee8baf6-f55e-4a3f-858f-4763394eb81d 2023-02-17 22:01:24,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47511da1a9a1c19c: from storage DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c node DatanodeRegistration(127.0.0.1:36003, datanodeUuid=0ee8baf6-f55e-4a3f-858f-4763394eb81d, infoPort=38383, infoSecurePort=0, ipcPort=34935, storageInfo=lv=-57;cid=testClusterID;nsid=1358204291;c=1676671283547), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:24,122 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47511da1a9a1c19c: Processing first storage report for DS-992b1fe1-616a-400b-b4ff-6f891a6a4328 from datanode 0ee8baf6-f55e-4a3f-858f-4763394eb81d 2023-02-17 22:01:24,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47511da1a9a1c19c: from storage DS-992b1fe1-616a-400b-b4ff-6f891a6a4328 node DatanodeRegistration(127.0.0.1:36003, datanodeUuid=0ee8baf6-f55e-4a3f-858f-4763394eb81d, infoPort=38383, infoSecurePort=0, ipcPort=34935, storageInfo=lv=-57;cid=testClusterID;nsid=1358204291;c=1676671283547), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:24,130 DEBUG [Listener at localhost/34935] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890 2023-02-17 22:01:24,132 INFO [Listener at localhost/34935] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/zookeeper_0, clientPort=57146, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:01:24,133 INFO [Listener at localhost/34935] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57146 2023-02-17 22:01:24,134 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,134 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,145 INFO [Listener at localhost/34935] util.FSUtils(479): Created version file at hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d with version=8 2023-02-17 22:01:24,145 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,146 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,147 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34849/user/jenkins/test-data/4428e540-8a62-5a14-07aa-bffcccd86b7b/hbase-staging 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:24,149 INFO [Listener at localhost/34935] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:24,150 INFO [Listener at localhost/34935] ipc.NettyRpcServer(120): Bind to /172.31.2.10:32997 2023-02-17 22:01:24,151 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,152 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,152 INFO [Listener at localhost/34935] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32997 connecting to ZooKeeper ensemble=127.0.0.1:57146 2023-02-17 22:01:24,159 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:329970x0, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:24,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32997-0x100644e53920000 connected 2023-02-17 22:01:24,174 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:24,174 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:24,175 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:24,178 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32997 2023-02-17 22:01:24,178 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32997 2023-02-17 22:01:24,180 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32997 2023-02-17 22:01:24,180 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32997 2023-02-17 22:01:24,181 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32997 2023-02-17 22:01:24,181 INFO [Listener at localhost/34935] master.HMaster(444): hbase.rootdir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d, hbase.cluster.distributed=false 2023-02-17 22:01:24,193 INFO [Listener at localhost/34935] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:24,193 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,193 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,194 INFO [Listener at localhost/34935] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:24,194 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,194 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:24,194 INFO [Listener at localhost/34935] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:24,195 INFO [Listener at localhost/34935] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46531 2023-02-17 22:01:24,195 INFO [Listener at localhost/34935] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:24,196 DEBUG [Listener at localhost/34935] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:24,197 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,197 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,198 INFO [Listener at localhost/34935] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46531 connecting to ZooKeeper ensemble=127.0.0.1:57146 2023-02-17 22:01:24,201 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:465310x0, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:24,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46531-0x100644e53920001 connected 2023-02-17 22:01:24,202 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:24,203 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:24,203 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:24,204 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46531 2023-02-17 22:01:24,204 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46531 2023-02-17 22:01:24,204 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46531 2023-02-17 22:01:24,204 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46531 2023-02-17 22:01:24,205 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46531 2023-02-17 22:01:24,215 INFO [Listener at localhost/34935] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:24,216 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,216 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,216 INFO [Listener at localhost/34935] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:24,216 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:24,216 INFO [Listener at localhost/34935] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:24,216 INFO [Listener at localhost/34935] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:24,217 INFO [Listener at localhost/34935] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35905 2023-02-17 22:01:24,217 INFO [Listener at localhost/34935] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:24,218 DEBUG [Listener at localhost/34935] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:24,219 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,219 INFO [Listener at localhost/34935] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,220 INFO [Listener at localhost/34935] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35905 connecting to ZooKeeper ensemble=127.0.0.1:57146 2023-02-17 22:01:24,224 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:359050x0, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:24,226 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): regionserver:359050x0, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:24,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35905-0x100644e53920002 connected 2023-02-17 22:01:24,226 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:24,227 DEBUG [Listener at localhost/34935] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:24,228 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35905 2023-02-17 22:01:24,228 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35905 2023-02-17 22:01:24,228 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35905 2023-02-17 22:01:24,228 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35905 2023-02-17 22:01:24,228 DEBUG [Listener at localhost/34935] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35905 2023-02-17 22:01:24,229 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,231 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:24,231 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,232 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:24,232 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:24,232 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,232 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:24,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:24,234 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,32997,1676671284148 from backup master directory 2023-02-17 22:01:24,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:24,235 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,235 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:24,235 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:24,235 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,246 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/hbase.id with ID: c0c7c11e-c505-4818-abfb-eefb302fd9e0 2023-02-17 22:01:24,255 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:24,258 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,264 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2632d3b8 to 127.0.0.1:57146 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:24,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fd16fb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:24,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:24,271 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:01:24,271 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:24,273 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store-tmp 2023-02-17 22:01:24,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:24,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:24,710 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:24,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:24,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:24,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:24,710 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:24,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:24,711 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/WALs/jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,714 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C32997%2C1676671284148, suffix=, logDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/WALs/jenkins-hbase9.apache.org,32997,1676671284148, archiveDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:24,731 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK] 2023-02-17 22:01:24,731 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK] 2023-02-17 22:01:24,733 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/WALs/jenkins-hbase9.apache.org,32997,1676671284148/jenkins-hbase9.apache.org%2C32997%2C1676671284148.1676671284714 2023-02-17 22:01:24,734 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK], DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK]] 2023-02-17 22:01:24,734 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:24,734 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:24,734 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:24,734 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:24,735 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:24,736 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:24,737 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:24,737 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:24,738 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:24,738 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:24,740 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:24,742 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:24,742 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71539380, jitterRate=0.06601983308792114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:24,742 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:24,742 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:24,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 22:01:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 22:01:24,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:24,745 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:24,746 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:24,757 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:24,757 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:24,758 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:24,758 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:24,758 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:24,760 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,760 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:24,761 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:24,761 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:24,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:24,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:24,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:24,768 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,32997,1676671284148, sessionid=0x100644e53920000, setting cluster-up flag (Was=false) 2023-02-17 22:01:24,772 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,777 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:24,777 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,780 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,784 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:24,785 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:24,785 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.hbase-snapshot/.tmp 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:24,787 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671314789 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:24,789 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:24,789 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,789 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:24,790 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671284790,5,FailOnTimeoutGroup] 2023-02-17 22:01:24,790 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671284790,5,FailOnTimeoutGroup] 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,791 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:24,799 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:24,800 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:24,800 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d 2023-02-17 22:01:24,805 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:24,806 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:24,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/info 2023-02-17 22:01:24,807 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:24,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:24,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:24,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:24,809 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:24,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:24,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:24,811 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/table 2023-02-17 22:01:24,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:24,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:24,812 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740 2023-02-17 22:01:24,812 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740 2023-02-17 22:01:24,814 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:24,815 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:24,816 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:24,817 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73954860, jitterRate=0.10201328992843628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:24,817 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:24,817 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:24,817 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:24,817 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:24,817 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:24,817 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:24,817 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:24,817 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:24,818 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:24,818 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:24,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:24,820 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:24,821 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:24,831 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(952): ClusterId : c0c7c11e-c505-4818-abfb-eefb302fd9e0 2023-02-17 22:01:24,831 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(952): ClusterId : c0c7c11e-c505-4818-abfb-eefb302fd9e0 2023-02-17 22:01:24,831 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:24,831 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:24,833 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:24,833 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:24,833 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:24,833 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:24,836 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:24,838 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:24,838 DEBUG [RS:1;jenkins-hbase9:35905] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce66fd5 to 127.0.0.1:57146 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:24,838 DEBUG [RS:0;jenkins-hbase9:46531] zookeeper.ReadOnlyZKClient(139): Connect 0x6f410412 to 127.0.0.1:57146 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:24,844 DEBUG [RS:1;jenkins-hbase9:35905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32219639, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:24,844 DEBUG [RS:0;jenkins-hbase9:46531] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6186f78a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:24,844 DEBUG [RS:1;jenkins-hbase9:35905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@361e04a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:24,844 DEBUG [RS:0;jenkins-hbase9:46531] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65b96f62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:24,855 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:46531 2023-02-17 22:01:24,855 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:35905 2023-02-17 22:01:24,855 INFO [RS:0;jenkins-hbase9:46531] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:24,855 INFO [RS:1;jenkins-hbase9:35905] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:24,855 INFO [RS:1;jenkins-hbase9:35905] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:24,855 INFO [RS:0;jenkins-hbase9:46531] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:24,855 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:24,855 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:24,855 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,32997,1676671284148 with isa=jenkins-hbase9.apache.org/172.31.2.10:35905, startcode=1676671284215 2023-02-17 22:01:24,855 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,32997,1676671284148 with isa=jenkins-hbase9.apache.org/172.31.2.10:46531, startcode=1676671284193 2023-02-17 22:01:24,856 DEBUG [RS:1;jenkins-hbase9:35905] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:24,856 DEBUG [RS:0;jenkins-hbase9:46531] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:24,860 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37615, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:24,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,862 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47273, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:24,863 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d 2023-02-17 22:01:24,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,863 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34849 2023-02-17 22:01:24,863 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:24,863 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d 2023-02-17 22:01:24,863 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34849 2023-02-17 22:01:24,863 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:24,866 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:24,869 DEBUG [RS:1;jenkins-hbase9:35905] zookeeper.ZKUtil(162): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46531,1676671284193] 2023-02-17 22:01:24,870 WARN [RS:1;jenkins-hbase9:35905] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:24,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35905,1676671284215] 2023-02-17 22:01:24,870 INFO [RS:1;jenkins-hbase9:35905] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:24,870 DEBUG [RS:0;jenkins-hbase9:46531] zookeeper.ZKUtil(162): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,870 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,870 WARN [RS:0;jenkins-hbase9:46531] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:24,870 INFO [RS:0;jenkins-hbase9:46531] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:24,870 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,879 DEBUG [RS:1;jenkins-hbase9:35905] zookeeper.ZKUtil(162): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,879 DEBUG [RS:0;jenkins-hbase9:46531] zookeeper.ZKUtil(162): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,879 DEBUG [RS:1;jenkins-hbase9:35905] zookeeper.ZKUtil(162): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,879 DEBUG [RS:0;jenkins-hbase9:46531] zookeeper.ZKUtil(162): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,880 DEBUG [RS:0;jenkins-hbase9:46531] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:24,880 INFO [RS:0;jenkins-hbase9:46531] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:24,881 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:24,881 INFO [RS:1;jenkins-hbase9:35905] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:24,882 INFO [RS:0;jenkins-hbase9:46531] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:24,882 INFO [RS:0;jenkins-hbase9:46531] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:24,882 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,882 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:24,883 INFO [RS:1;jenkins-hbase9:35905] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:24,883 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,884 INFO [RS:1;jenkins-hbase9:35905] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:24,884 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,884 DEBUG [RS:0;jenkins-hbase9:46531] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,887 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:24,888 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,889 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,889 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,889 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,889 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,889 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,889 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,889 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,890 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,890 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:24,890 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,890 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,890 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,890 DEBUG [RS:1;jenkins-hbase9:35905] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:24,891 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,891 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,891 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,901 INFO [RS:0;jenkins-hbase9:46531] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:24,901 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46531,1676671284193-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,902 INFO [RS:1;jenkins-hbase9:35905] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:24,902 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35905,1676671284215-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:24,915 INFO [RS:0;jenkins-hbase9:46531] regionserver.Replication(203): jenkins-hbase9.apache.org,46531,1676671284193 started 2023-02-17 22:01:24,915 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,46531,1676671284193, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46531, sessionid=0x100644e53920001 2023-02-17 22:01:24,916 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:24,916 DEBUG [RS:0;jenkins-hbase9:46531] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,916 DEBUG [RS:0;jenkins-hbase9:46531] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46531,1676671284193' 2023-02-17 22:01:24,916 DEBUG [RS:0;jenkins-hbase9:46531] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:24,916 DEBUG [RS:0;jenkins-hbase9:46531] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46531,1676671284193' 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:24,917 DEBUG [RS:0;jenkins-hbase9:46531] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:24,918 INFO [RS:0;jenkins-hbase9:46531] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:24,918 INFO [RS:0;jenkins-hbase9:46531] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:24,918 INFO [RS:1;jenkins-hbase9:35905] regionserver.Replication(203): jenkins-hbase9.apache.org,35905,1676671284215 started 2023-02-17 22:01:24,918 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,35905,1676671284215, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35905, sessionid=0x100644e53920002 2023-02-17 22:01:24,918 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:24,918 DEBUG [RS:1;jenkins-hbase9:35905] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35905,1676671284215' 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35905,1676671284215' 2023-02-17 22:01:24,919 DEBUG [RS:1;jenkins-hbase9:35905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:24,920 DEBUG [RS:1;jenkins-hbase9:35905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:24,920 DEBUG [RS:1;jenkins-hbase9:35905] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:24,920 INFO [RS:1;jenkins-hbase9:35905] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:24,920 INFO [RS:1;jenkins-hbase9:35905] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:24,971 DEBUG [jenkins-hbase9:32997] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:24,971 DEBUG [jenkins-hbase9:32997] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:24,973 DEBUG [jenkins-hbase9:32997] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:24,973 DEBUG [jenkins-hbase9:32997] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:24,973 DEBUG [jenkins-hbase9:32997] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:24,974 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35905,1676671284215, state=OPENING 2023-02-17 22:01:24,975 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:24,977 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:24,978 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:24,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35905,1676671284215}] 2023-02-17 22:01:25,131 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:25,132 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:25,133 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:25,136 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:25,137 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:25,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35905%2C1676671284215.meta, suffix=.meta, logDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,35905,1676671284215, archiveDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/oldWALs, maxLogs=32 2023-02-17 22:01:25,152 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK] 2023-02-17 22:01:25,152 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK] 2023-02-17 22:01:25,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,35905,1676671284215/jenkins-hbase9.apache.org%2C35905%2C1676671284215.meta.1676671285138.meta 2023-02-17 22:01:25,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK], DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK]] 2023-02-17 22:01:25,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:25,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:25,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:25,155 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:25,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:25,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:25,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:25,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:25,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:25,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/info 2023-02-17 22:01:25,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/info 2023-02-17 22:01:25,157 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:25,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:25,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:25,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:25,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:25,159 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:25,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:25,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:25,160 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/table 2023-02-17 22:01:25,160 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/table 2023-02-17 22:01:25,160 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:25,161 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:25,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740 2023-02-17 22:01:25,163 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740 2023-02-17 22:01:25,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:25,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:25,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63303418, jitterRate=-0.05670556426048279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:25,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:25,168 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671285131 2023-02-17 22:01:25,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:25,172 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:25,172 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35905,1676671284215, state=OPEN 2023-02-17 22:01:25,174 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:25,174 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:25,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:25,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35905,1676671284215 in 196 msec 2023-02-17 22:01:25,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:25,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-17 22:01:25,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-17 22:01:25,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671285178, completionTime=-1 2023-02-17 22:01:25,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:25,179 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:25,182 DEBUG [hconnection-0x24641e19-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:25,183 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:25,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:25,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671345184 2023-02-17 22:01:25,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671405184 2023-02-17 22:01:25,184 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32997,1676671284148-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32997,1676671284148-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32997,1676671284148-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:32997, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:25,192 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:25,193 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:25,194 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:25,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:25,195 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:25,196 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,197 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f empty. 2023-02-17 22:01:25,197 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,197 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:25,211 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:25,212 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8da9aa35613073bd4d6cf9cae75f7b2f, NAME => 'hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp 2023-02-17 22:01:25,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:25,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8da9aa35613073bd4d6cf9cae75f7b2f, disabling compactions & flushes 2023-02-17 22:01:25,219 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. after waiting 0 ms 2023-02-17 22:01:25,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,219 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,219 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8da9aa35613073bd4d6cf9cae75f7b2f: 2023-02-17 22:01:25,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:25,222 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671285221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671285221"}]},"ts":"1676671285221"} 2023-02-17 22:01:25,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:25,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:25,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671285224"}]},"ts":"1676671285224"} 2023-02-17 22:01:25,225 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:25,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:25,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:25,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:25,229 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:25,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8da9aa35613073bd4d6cf9cae75f7b2f, ASSIGN}] 2023-02-17 22:01:25,232 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8da9aa35613073bd4d6cf9cae75f7b2f, ASSIGN 2023-02-17 22:01:25,232 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8da9aa35613073bd4d6cf9cae75f7b2f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35905,1676671284215; forceNewPlan=false, retain=false 2023-02-17 22:01:25,382 INFO [jenkins-hbase9:32997] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:25,383 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8da9aa35613073bd4d6cf9cae75f7b2f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:25,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671285383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671285383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671285383"}]},"ts":"1676671285383"} 2023-02-17 22:01:25,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8da9aa35613073bd4d6cf9cae75f7b2f, server=jenkins-hbase9.apache.org,35905,1676671284215}] 2023-02-17 22:01:25,505 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 22:01:25,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,545 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35905%2C1676671284215, suffix=, logDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,35905,1676671284215, archiveDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/oldWALs, maxLogs=32 2023-02-17 22:01:25,567 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK] 2023-02-17 22:01:25,571 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK] 2023-02-17 22:01:25,575 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,35905,1676671284215/jenkins-hbase9.apache.org%2C35905%2C1676671284215.1676671285545 2023-02-17 22:01:25,575 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK], DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK]] 2023-02-17 22:01:25,575 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8da9aa35613073bd4d6cf9cae75f7b2f, NAME => 'hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:25,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:25,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,577 INFO [StoreOpener-8da9aa35613073bd4d6cf9cae75f7b2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,579 DEBUG [StoreOpener-8da9aa35613073bd4d6cf9cae75f7b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/info 2023-02-17 22:01:25,579 DEBUG [StoreOpener-8da9aa35613073bd4d6cf9cae75f7b2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/info 2023-02-17 22:01:25,579 INFO [StoreOpener-8da9aa35613073bd4d6cf9cae75f7b2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8da9aa35613073bd4d6cf9cae75f7b2f columnFamilyName info 2023-02-17 22:01:25,582 INFO [StoreOpener-8da9aa35613073bd4d6cf9cae75f7b2f-1] regionserver.HStore(310): Store=8da9aa35613073bd4d6cf9cae75f7b2f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:25,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,586 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:25,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:25,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 8da9aa35613073bd4d6cf9cae75f7b2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59423818, jitterRate=-0.11451610922813416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:25,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 8da9aa35613073bd4d6cf9cae75f7b2f: 2023-02-17 22:01:25,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f., pid=6, masterSystemTime=1676671285537 2023-02-17 22:01:25,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,592 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:25,592 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8da9aa35613073bd4d6cf9cae75f7b2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:25,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671285592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671285592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671285592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671285592"}]},"ts":"1676671285592"} 2023-02-17 22:01:25,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:25,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8da9aa35613073bd4d6cf9cae75f7b2f, server=jenkins-hbase9.apache.org,35905,1676671284215 in 209 msec 2023-02-17 22:01:25,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:25,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8da9aa35613073bd4d6cf9cae75f7b2f, ASSIGN in 366 msec 2023-02-17 22:01:25,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:25,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671285598"}]},"ts":"1676671285598"} 2023-02-17 22:01:25,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:25,603 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:25,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 411 msec 2023-02-17 22:01:25,694 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:25,696 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:25,696 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:25,702 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:25,710 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:25,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-17 22:01:25,720 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:25,726 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:25,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-17 22:01:25,735 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:25,737 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:25,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.502sec 2023-02-17 22:01:25,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:25,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:25,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:25,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32997,1676671284148-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:25,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,32997,1676671284148-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:25,739 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:25,832 DEBUG [Listener at localhost/34935] zookeeper.ReadOnlyZKClient(139): Connect 0x62a707c6 to 127.0.0.1:57146 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:25,839 DEBUG [Listener at localhost/34935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52be757e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:25,840 DEBUG [hconnection-0x6ec8889e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:25,842 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:25,844 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:25,844 DEBUG [Listener at localhost/34935] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:25,846 DEBUG [Listener at localhost/34935] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:25,847 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54882, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:25,848 INFO [Listener at localhost/34935] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:25,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:25,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:25,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.2.10:54882 deadline: 1676671345849, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:25,850 INFO [Listener at localhost/34935] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-17 22:01:25,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:25,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:25,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-17 22:01:25,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:25,866 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:25,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:25,869 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 empty. 2023-02-17 22:01:25,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:25,870 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-17 22:01:25,886 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:25,887 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4101fe197c4f9aa4417895407c315150, NAME => 'testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp 2023-02-17 22:01:25,894 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:25,894 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 4101fe197c4f9aa4417895407c315150, disabling compactions & flushes 2023-02-17 22:01:25,894 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:25,894 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:25,894 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. after waiting 0 ms 2023-02-17 22:01:25,894 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:25,894 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:25,894 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 4101fe197c4f9aa4417895407c315150: 2023-02-17 22:01:25,896 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:25,897 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676671285897"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671285897"}]},"ts":"1676671285897"} 2023-02-17 22:01:25,899 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:25,900 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:25,900 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671285900"}]},"ts":"1676671285900"} 2023-02-17 22:01:25,901 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-17 22:01:25,904 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:25,905 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:25,905 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:25,905 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:25,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, ASSIGN}] 2023-02-17 22:01:25,907 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, ASSIGN 2023-02-17 22:01:25,907 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35905,1676671284215; forceNewPlan=false, retain=false 2023-02-17 22:01:25,919 INFO [RS:0;jenkins-hbase9:46531] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46531%2C1676671284193, suffix=, logDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,46531,1676671284193, archiveDir=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/oldWALs, maxLogs=32 2023-02-17 22:01:25,935 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK] 2023-02-17 22:01:25,935 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK] 2023-02-17 22:01:25,937 INFO [RS:0;jenkins-hbase9:46531] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/WALs/jenkins-hbase9.apache.org,46531,1676671284193/jenkins-hbase9.apache.org%2C46531%2C1676671284193.1676671285920 2023-02-17 22:01:25,937 DEBUG [RS:0;jenkins-hbase9:46531] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39427,DS-51eafed2-f20b-4649-ae43-b7a45969bc37,DISK], DatanodeInfoWithStorage[127.0.0.1:36003,DS-7c6b247f-ccb4-4af7-aa3a-87c2cdeea55c,DISK]] 2023-02-17 22:01:25,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:26,058 INFO [jenkins-hbase9:32997] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:26,059 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4101fe197c4f9aa4417895407c315150, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676671286059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671286059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671286059"}]},"ts":"1676671286059"} 2023-02-17 22:01:26,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 4101fe197c4f9aa4417895407c315150, server=jenkins-hbase9.apache.org,35905,1676671284215}] 2023-02-17 22:01:26,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:26,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:26,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4101fe197c4f9aa4417895407c315150, NAME => 'testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:26,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:26,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,219 INFO [StoreOpener-4101fe197c4f9aa4417895407c315150-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,220 DEBUG [StoreOpener-4101fe197c4f9aa4417895407c315150-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1 2023-02-17 22:01:26,220 DEBUG [StoreOpener-4101fe197c4f9aa4417895407c315150-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1 2023-02-17 22:01:26,221 INFO [StoreOpener-4101fe197c4f9aa4417895407c315150-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4101fe197c4f9aa4417895407c315150 columnFamilyName f1 2023-02-17 22:01:26,221 INFO [StoreOpener-4101fe197c4f9aa4417895407c315150-1] regionserver.HStore(310): Store=4101fe197c4f9aa4417895407c315150/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:26,221 INFO [StoreOpener-4101fe197c4f9aa4417895407c315150-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,222 DEBUG [StoreOpener-4101fe197c4f9aa4417895407c315150-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2 2023-02-17 22:01:26,222 DEBUG [StoreOpener-4101fe197c4f9aa4417895407c315150-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2 2023-02-17 22:01:26,222 INFO [StoreOpener-4101fe197c4f9aa4417895407c315150-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4101fe197c4f9aa4417895407c315150 columnFamilyName f2 2023-02-17 22:01:26,223 INFO [StoreOpener-4101fe197c4f9aa4417895407c315150-1] regionserver.HStore(310): Store=4101fe197c4f9aa4417895407c315150/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:26,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:26,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:26,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 4101fe197c4f9aa4417895407c315150; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71542083, jitterRate=0.06606011092662811}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:26,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 4101fe197c4f9aa4417895407c315150: 2023-02-17 22:01:26,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150., pid=12, masterSystemTime=1676671286214 2023-02-17 22:01:26,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:26,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:26,231 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4101fe197c4f9aa4417895407c315150, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,231 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676671286231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671286231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671286231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671286231"}]},"ts":"1676671286231"} 2023-02-17 22:01:26,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 22:01:26,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 4101fe197c4f9aa4417895407c315150, server=jenkins-hbase9.apache.org,35905,1676671284215 in 171 msec 2023-02-17 22:01:26,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 22:01:26,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, ASSIGN in 329 msec 2023-02-17 22:01:26,236 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:26,236 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671286236"}]},"ts":"1676671286236"} 2023-02-17 22:01:26,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-17 22:01:26,240 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:26,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 387 msec 2023-02-17 22:01:26,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:26,468 INFO [Listener at localhost/34935] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-17 22:01:26,468 DEBUG [Listener at localhost/34935] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-17 22:01:26,468 INFO [Listener at localhost/34935] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:26,470 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-17 22:01:26,471 INFO [Listener at localhost/34935] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:26,471 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-17 22:01:26,471 INFO [Listener at localhost/34935] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:26,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:26,627 INFO [Listener at localhost/34935] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:26,627 INFO [Listener at localhost/34935] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:26,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 22:01:26,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671286629 (current time:1676671286629). 2023-02-17 22:01:26,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:26,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] zookeeper.ReadOnlyZKClient(139): Connect 0x78967d35 to 127.0.0.1:57146 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:26,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4effa4b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:26,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:26,637 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:26,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78967d35 to 127.0.0.1:57146 2023-02-17 22:01:26,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:26,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:26,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 22:01:26,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 22:01:26,642 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 22:01:26,642 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676671886642 2023-02-17 22:01:26,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 22:01:26,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:26,643 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:26,643 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:26,644 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 22:01:26,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 22:01:26,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-17 22:01:26,646 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 22:01:26,646 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676671886646 2023-02-17 22:01:26,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-17 22:01:26,661 INFO [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-17 22:01:26,661 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:26,662 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-17 22:01:26,662 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-17 22:01:26,662 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,662 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,663 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:26,663 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:26,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:26,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:26,663 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,664 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,664 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:26,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-17 22:01:26,665 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-17 22:01:26,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 22:01:26,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 22:01:26,667 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 22:01:26,667 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46531,1676671284193' joining acquired barrier for procedure (foo) in zk 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 22:01:26,668 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35905,1676671284215' joining acquired barrier for procedure (foo) in zk 2023-02-17 22:01:26,671 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,671 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,671 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:26,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:26,671 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,671 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:26,672 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,672 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:26,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:26,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:26,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:26,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:26,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35905,1676671284215' joining acquired barrier for procedure 'foo' on coordinator 2023-02-17 22:01:26,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@602d5808[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:26,673 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-17 22:01:26,673 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,674 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 22:01:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 22:01:26,674 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,675 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 22:01:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 22:01:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:26,675 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,46531,1676671284193' in zk 2023-02-17 22:01:26,675 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. started... 2023-02-17 22:01:26,676 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4101fe197c4f9aa4417895407c315150 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 22:01:26,677 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 22:01:26,677 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:26,677 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 22:01:26,691 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f1/d361ad47dbbd487297d18b9d2691f3ae 2023-02-17 22:01:26,709 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f2/34cdb01668bb408eb03b7868321ffc59 2023-02-17 22:01:26,715 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f1/d361ad47dbbd487297d18b9d2691f3ae as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/d361ad47dbbd487297d18b9d2691f3ae 2023-02-17 22:01:26,719 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/d361ad47dbbd487297d18b9d2691f3ae, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:26,720 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f2/34cdb01668bb408eb03b7868321ffc59 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/34cdb01668bb408eb03b7868321ffc59 2023-02-17 22:01:26,726 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/34cdb01668bb408eb03b7868321ffc59, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:26,727 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 4101fe197c4f9aa4417895407c315150 in 52ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:26,727 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-17 22:01:26,727 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4101fe197c4f9aa4417895407c315150: 2023-02-17 22:01:26,727 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.' region-info for snapshot=foo 2023-02-17 22:01:26,727 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:26,728 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/d361ad47dbbd487297d18b9d2691f3ae] hfiles 2023-02-17 22:01:26,728 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/d361ad47dbbd487297d18b9d2691f3ae for snapshot=foo 2023-02-17 22:01:26,728 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/34cdb01668bb408eb03b7868321ffc59] hfiles 2023-02-17 22:01:26,728 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/34cdb01668bb408eb03b7868321ffc59 for snapshot=foo 2023-02-17 22:01:26,736 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. completed. 2023-02-17 22:01:26,736 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:26,737 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 22:01:26,737 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 22:01:26,737 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,737 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 22:01:26,737 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,35905,1676671284215' in zk 2023-02-17 22:01:26,739 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,739 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 22:01:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:26,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:26,739 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:26,740 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 22:01:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:26,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:26,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,744 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:26,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-17 22:01:26,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase9.apache.org,35905,1676671284215': 2023-02-17 22:01:26,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:26,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35905,1676671284215' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-17 22:01:26,746 INFO [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-17 22:01:26,746 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:26,746 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:26,746 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-17 22:01:26,746 INFO [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:26,746 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:26,748 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,748 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,748 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:26,749 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:26,749 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:26,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:26,749 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:26,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:26,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:26,752 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:26,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:26,755 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:26,756 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,764 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:26,764 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:26,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:26,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:26,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:26,768 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:26,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:26,769 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:26,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-17 22:01:26,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-17 22:01:26,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.hbase-snapshot/.tmp/foo 2023-02-17 22:01:26,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.hbase-snapshot/.tmp/foo to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.hbase-snapshot/foo 2023-02-17 22:01:26,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-17 22:01:26,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.hbase-snapshot/.tmp/foo 2023-02-17 22:01:26,840 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.hbase-snapshot/.tmp/foo 2023-02-17 22:01:26,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676671286642Consolidate snapshot: foo at 1676671286770 (+128 ms)Loading Region manifests for foo at 1676671286770Writing data manifest for foo at 1676671286786 (+16 ms)Verifying snapshot: foo at 1676671286799 (+13 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676671286840 (+41 ms) 2023-02-17 22:01:26,842 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 22:01:26,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 199 msec 2023-02-17 22:01:26,946 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:26,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-17 22:01:26,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:26,948 INFO [Listener at localhost/34935] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:26,956 INFO [Listener at localhost/34935] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:26,962 INFO [Listener at localhost/34935] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:27,010 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,128 INFO [Listener at localhost/34935] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:27,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:27,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,139 INFO [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-17 22:01:27,139 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:27,140 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-17 22:01:27,140 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-17 22:01:27,140 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,140 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,142 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,142 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:27,142 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:27,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:27,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:27,143 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,143 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,144 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-17 22:01:27,144 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-17 22:01:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-17 22:01:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 22:01:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:27,149 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:27,149 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. started... 2023-02-17 22:01:27,150 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-17 22:01:27,150 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-17 22:01:27,150 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46531,1676671284193' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-17 22:01:27,150 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4101fe197c4f9aa4417895407c315150 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 22:01:27,152 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,152 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,152 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:27,167 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f1/aecc5b955ce14b08a9148dce90f36b00 2023-02-17 22:01:27,184 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f2/5a312db16ed147b0844570505bf26005 2023-02-17 22:01:27,188 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f1/aecc5b955ce14b08a9148dce90f36b00 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/aecc5b955ce14b08a9148dce90f36b00 2023-02-17 22:01:27,192 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/aecc5b955ce14b08a9148dce90f36b00, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:27,193 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/.tmp/f2/5a312db16ed147b0844570505bf26005 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/5a312db16ed147b0844570505bf26005 2023-02-17 22:01:27,197 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/5a312db16ed147b0844570505bf26005, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:27,198 INFO [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 4101fe197c4f9aa4417895407c315150 in 48ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:27,199 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4101fe197c4f9aa4417895407c315150: 2023-02-17 22:01:27,199 DEBUG [rs(jenkins-hbase9.apache.org,35905,1676671284215)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,199 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 22:01:27,199 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 22:01:27,199 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,199 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-17 22:01:27,199 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35905,1676671284215' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-17 22:01:27,201 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,201 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:27,201 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,201 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:27,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35905,1676671284215' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-17 22:01:27,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6412c0d5[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:27,202 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-17 22:01:27,203 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,204 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-17 22:01:27,204 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-17 22:01:27,204 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-17 22:01:27,204 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,204 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:27,204 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase9.apache.org,46531,1676671284193' in zk 2023-02-17 22:01:27,204 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-17 22:01:27,204 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase9.apache.org,35905,1676671284215' in zk 2023-02-17 22:01:27,207 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-17 22:01:27,207 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:27,207 DEBUG [member: 'jenkins-hbase9.apache.org,46531,1676671284193' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-17 22:01:27,208 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,208 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-17 22:01:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:27,208 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:27,208 DEBUG [member: 'jenkins-hbase9.apache.org,35905,1676671284215' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-17 22:01:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase9.apache.org,35905,1676671284215': 2023-02-17 22:01:27,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35905,1676671284215' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-17 22:01:27,211 INFO [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-17 22:01:27,211 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:27,211 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:27,211 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,211 INFO [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:27,213 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:27,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:27,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:27,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:27,213 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:27,214 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:27,216 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,216 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,218 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,218 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:27,218 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:27,218 DEBUG [(jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:27,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:27,218 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:27,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-17 22:01:27,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:27,218 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:27,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:27,218 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:27,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:27,219 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:27,220 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,320 DEBUG [Listener at localhost/34935] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:27,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:27,326 INFO [Listener at localhost/34935] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676671286629 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:27,327 DEBUG [Listener at localhost/34935] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34849/user/jenkins/test-data/4428e540-8a62-5a14-07aa-bffcccd86b7b/foo/cf9b19b1-2499-4224-bf28-2b4cc1fe018a/data/default/testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,327 INFO [Listener at localhost/34935] snapshot.RestoreSnapshotHelper(239): region to add: 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:27,327 INFO [Listener at localhost/34935] snapshot.RestoreSnapshotHelper(585): clone region=4101fe197c4f9aa4417895407c315150 as 4101fe197c4f9aa4417895407c315150 in snapshot foo 2023-02-17 22:01:27,328 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4101fe197c4f9aa4417895407c315150, NAME => 'testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34849/user/jenkins/test-data/4428e540-8a62-5a14-07aa-bffcccd86b7b/foo/cf9b19b1-2499-4224-bf28-2b4cc1fe018a 2023-02-17 22:01:27,362 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:27,362 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d361ad47dbbd487297d18b9d2691f3ae from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,366 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34cdb01668bb408eb03b7868321ffc59 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,370 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4101fe197c4f9aa4417895407c315150, disabling compactions & flushes 2023-02-17 22:01:27,370 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,370 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,370 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. after waiting 0 ms 2023-02-17 22:01:27,370 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,370 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,370 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4101fe197c4f9aa4417895407c315150: 2023-02-17 22:01:27,370 INFO [Listener at localhost/34935] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676671286629 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:27,370 DEBUG [Listener at localhost/34935] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34849/user/jenkins/test-data/4428e540-8a62-5a14-07aa-bffcccd86b7b/foo/cf9b19b1-2499-4224-bf28-2b4cc1fe018a 2023-02-17 22:01:27,371 DEBUG [Listener at localhost/34935] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34849/user/jenkins/test-data/4428e540-8a62-5a14-07aa-bffcccd86b7b/foo/cf9b19b1-2499-4224-bf28-2b4cc1fe018a 2023-02-17 22:01:27,371 DEBUG [Listener at localhost/34935] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:27,372 DEBUG [Listener at localhost/34935] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:27,372 DEBUG [Listener at localhost/34935] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-17 22:01:27,373 DEBUG [Listener at localhost/34935] util.CommonFSUtils(699): |----------4101fe197c4f9aa4417895407c315150/ 2023-02-17 22:01:27,373 DEBUG [Listener at localhost/34935] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:27,373 DEBUG [Listener at localhost/34935] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:27,374 DEBUG [Listener at localhost/34935] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=4101fe197c4f9aa4417895407c315150-d361ad47dbbd487297d18b9d2691f3ae 2023-02-17 22:01:27,374 DEBUG [Listener at localhost/34935] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:27,374 DEBUG [Listener at localhost/34935] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=4101fe197c4f9aa4417895407c315150-34cdb01668bb408eb03b7868321ffc59 2023-02-17 22:01:27,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "foo" 2023-02-17 22:01:27,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-17 22:01:27,381 INFO [Listener at localhost/34935] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671287386"}]},"ts":"1676671287386"} 2023-02-17 22:01:27,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:27,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-17 22:01:27,390 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-17 22:01:27,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, UNASSIGN}] 2023-02-17 22:01:27,392 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, UNASSIGN 2023-02-17 22:01:27,394 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4101fe197c4f9aa4417895407c315150, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,394 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676671287393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671287393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671287393"}]},"ts":"1676671287393"} 2023-02-17 22:01:27,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 4101fe197c4f9aa4417895407c315150, server=jenkins-hbase9.apache.org,35905,1676671284215}] 2023-02-17 22:01:27,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:27,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:27,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 4101fe197c4f9aa4417895407c315150, disabling compactions & flushes 2023-02-17 22:01:27,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. after waiting 0 ms 2023-02-17 22:01:27,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:27,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150. 2023-02-17 22:01:27,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 4101fe197c4f9aa4417895407c315150: 2023-02-17 22:01:27,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:27,556 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4101fe197c4f9aa4417895407c315150, regionState=CLOSED 2023-02-17 22:01:27,556 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676671287556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671287556"}]},"ts":"1676671287556"} 2023-02-17 22:01:27,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 22:01:27,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 4101fe197c4f9aa4417895407c315150, server=jenkins-hbase9.apache.org,35905,1676671284215 in 160 msec 2023-02-17 22:01:27,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 22:01:27,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=4101fe197c4f9aa4417895407c315150, UNASSIGN in 168 msec 2023-02-17 22:01:27,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671287561"}]},"ts":"1676671287561"} 2023-02-17 22:01:27,562 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-17 22:01:27,563 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-17 22:01:27,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 183 msec 2023-02-17 22:01:27,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:27,690 INFO [Listener at localhost/34935] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-17 22:01:27,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,695 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,696 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:27,701 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:27,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1, FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2, FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/recovered.edits] 2023-02-17 22:01:27,708 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/aecc5b955ce14b08a9148dce90f36b00 to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/archive/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/aecc5b955ce14b08a9148dce90f36b00 2023-02-17 22:01:27,710 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/d361ad47dbbd487297d18b9d2691f3ae to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/archive/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f1/d361ad47dbbd487297d18b9d2691f3ae 2023-02-17 22:01:27,714 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/34cdb01668bb408eb03b7868321ffc59 to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/archive/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/34cdb01668bb408eb03b7868321ffc59 2023-02-17 22:01:27,716 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/5a312db16ed147b0844570505bf26005 to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/archive/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/f2/5a312db16ed147b0844570505bf26005 2023-02-17 22:01:27,722 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/recovered.edits/12.seqid to hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/archive/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150/recovered.edits/12.seqid 2023-02-17 22:01:27,722 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/4101fe197c4f9aa4417895407c315150 2023-02-17 22:01:27,722 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-17 22:01:27,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,726 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-17 22:01:27,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-17 22:01:27,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-17 22:01:27,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671287729"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:27,730 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 22:01:27,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4101fe197c4f9aa4417895407c315150, NAME => 'testInitTableSnapshotMapperJobConfig,,1676671285853.4101fe197c4f9aa4417895407c315150.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 22:01:27,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-17 22:01:27,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676671287730"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:27,734 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-17 22:01:27,737 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 22:01:27,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 45 msec 2023-02-17 22:01:27,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32997] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:27,799 INFO [Listener at localhost/34935] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-17 22:01:27,799 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:27,799 INFO [Listener at localhost/34935] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:27,801 DEBUG [Listener at localhost/34935] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62a707c6 to 127.0.0.1:57146 2023-02-17 22:01:27,801 DEBUG [Listener at localhost/34935] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:27,801 DEBUG [Listener at localhost/34935] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:27,801 DEBUG [Listener at localhost/34935] util.JVMClusterUtil(257): Found active master hash=823206700, stopped=false 2023-02-17 22:01:27,801 INFO [Listener at localhost/34935] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:27,803 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:27,803 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:27,803 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:27,803 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:27,804 INFO [Listener at localhost/34935] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:27,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:27,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:27,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:27,807 DEBUG [Listener at localhost/34935] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2632d3b8 to 127.0.0.1:57146 2023-02-17 22:01:27,807 DEBUG [Listener at localhost/34935] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:27,807 INFO [Listener at localhost/34935] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,46531,1676671284193' ***** 2023-02-17 22:01:27,807 INFO [Listener at localhost/34935] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:27,807 INFO [Listener at localhost/34935] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35905,1676671284215' ***** 2023-02-17 22:01:27,807 INFO [Listener at localhost/34935] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:27,807 INFO [RS:0;jenkins-hbase9:46531] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:27,808 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:27,808 INFO [RS:1;jenkins-hbase9:35905] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:27,808 INFO [RS:1;jenkins-hbase9:35905] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:27,811 INFO [RS:1;jenkins-hbase9:35905] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:27,811 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(3304): Received CLOSE for 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:27,811 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:27,812 DEBUG [RS:1;jenkins-hbase9:35905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ce66fd5 to 127.0.0.1:57146 2023-02-17 22:01:27,812 DEBUG [RS:1;jenkins-hbase9:35905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:27,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 8da9aa35613073bd4d6cf9cae75f7b2f, disabling compactions & flushes 2023-02-17 22:01:27,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:27,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:27,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. after waiting 0 ms 2023-02-17 22:01:27,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:27,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 8da9aa35613073bd4d6cf9cae75f7b2f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:27,808 INFO [RS:0;jenkins-hbase9:46531] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:27,819 INFO [RS:1;jenkins-hbase9:35905] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:27,823 INFO [RS:1;jenkins-hbase9:35905] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:27,823 INFO [RS:1;jenkins-hbase9:35905] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:27,823 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:27,808 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:27,823 INFO [RS:0;jenkins-hbase9:46531] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:27,824 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 22:01:27,824 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,824 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 8da9aa35613073bd4d6cf9cae75f7b2f=hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f.} 2023-02-17 22:01:27,825 DEBUG [RS:0;jenkins-hbase9:46531] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f410412 to 127.0.0.1:57146 2023-02-17 22:01:27,825 DEBUG [RS:0;jenkins-hbase9:46531] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:27,825 DEBUG [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1505): Waiting on 1588230740, 8da9aa35613073bd4d6cf9cae75f7b2f 2023-02-17 22:01:27,825 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,46531,1676671284193; all regions closed. 2023-02-17 22:01:27,835 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:27,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:27,835 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:27,835 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:27,835 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:27,836 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-17 22:01:27,841 DEBUG [RS:0;jenkins-hbase9:46531] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/oldWALs 2023-02-17 22:01:27,841 INFO [RS:0;jenkins-hbase9:46531] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46531%2C1676671284193:(num 1676671285920) 2023-02-17 22:01:27,841 DEBUG [RS:0;jenkins-hbase9:46531] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:27,841 INFO [RS:0;jenkins-hbase9:46531] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:27,842 INFO [RS:0;jenkins-hbase9:46531] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:27,842 INFO [RS:0;jenkins-hbase9:46531] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:27,842 INFO [RS:0;jenkins-hbase9:46531] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:27,842 INFO [RS:0;jenkins-hbase9:46531] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:27,842 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:27,847 INFO [RS:0;jenkins-hbase9:46531] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46531 2023-02-17 22:01:27,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/.tmp/info/5bfd3ada80074be1a5c0f6630bcdab96 2023-02-17 22:01:27,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/.tmp/info/5bfd3ada80074be1a5c0f6630bcdab96 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/info/5bfd3ada80074be1a5c0f6630bcdab96 2023-02-17 22:01:27,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/info/5bfd3ada80074be1a5c0f6630bcdab96, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:27,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8da9aa35613073bd4d6cf9cae75f7b2f in 41ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:27,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/.tmp/info/e05678b9ba144a87921072c83a764703 2023-02-17 22:01:27,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/namespace/8da9aa35613073bd4d6cf9cae75f7b2f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:27,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:27,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 8da9aa35613073bd4d6cf9cae75f7b2f: 2023-02-17 22:01:27,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671285192.8da9aa35613073bd4d6cf9cae75f7b2f. 2023-02-17 22:01:27,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e05678b9ba144a87921072c83a764703 2023-02-17 22:01:27,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/.tmp/rep_barrier/3597ed20d63041f7ae41cc43d7e3e432 2023-02-17 22:01:27,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3597ed20d63041f7ae41cc43d7e3e432 2023-02-17 22:01:27,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/.tmp/table/38115130e4b14a8cbde032a2428d80bf 2023-02-17 22:01:27,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38115130e4b14a8cbde032a2428d80bf 2023-02-17 22:01:27,888 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/.tmp/info/e05678b9ba144a87921072c83a764703 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/info/e05678b9ba144a87921072c83a764703 2023-02-17 22:01:27,891 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:27,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e05678b9ba144a87921072c83a764703 2023-02-17 22:01:27,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/info/e05678b9ba144a87921072c83a764703, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 22:01:27,894 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/.tmp/rep_barrier/3597ed20d63041f7ae41cc43d7e3e432 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/rep_barrier/3597ed20d63041f7ae41cc43d7e3e432 2023-02-17 22:01:27,894 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:27,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3597ed20d63041f7ae41cc43d7e3e432 2023-02-17 22:01:27,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/rep_barrier/3597ed20d63041f7ae41cc43d7e3e432, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 22:01:27,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/.tmp/table/38115130e4b14a8cbde032a2428d80bf as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/table/38115130e4b14a8cbde032a2428d80bf 2023-02-17 22:01:27,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38115130e4b14a8cbde032a2428d80bf 2023-02-17 22:01:27,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/table/38115130e4b14a8cbde032a2428d80bf, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 22:01:27,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 70ms, sequenceid=21, compaction requested=false 2023-02-17 22:01:27,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 22:01:27,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:27,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:27,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:27,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:27,933 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,933 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46531,1676671284193 2023-02-17 22:01:27,933 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:27,933 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:27,933 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48331104 rejected from java.util.concurrent.ThreadPoolExecutor@4c0c8cda[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:27,933 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:27,934 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46531,1676671284193] 2023-02-17 22:01:27,934 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46531,1676671284193; numProcessing=1 2023-02-17 22:01:27,935 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46531,1676671284193 already deleted, retry=false 2023-02-17 22:01:27,935 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46531,1676671284193 expired; onlineServers=1 2023-02-17 22:01:27,936 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 22:01:27,936 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 22:01:28,025 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35905,1676671284215; all regions closed. 2023-02-17 22:01:28,031 DEBUG [RS:1;jenkins-hbase9:35905] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/oldWALs 2023-02-17 22:01:28,031 INFO [RS:1;jenkins-hbase9:35905] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35905%2C1676671284215.meta:.meta(num 1676671285138) 2023-02-17 22:01:28,038 DEBUG [RS:1;jenkins-hbase9:35905] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/oldWALs 2023-02-17 22:01:28,038 INFO [RS:1;jenkins-hbase9:35905] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35905%2C1676671284215:(num 1676671285545) 2023-02-17 22:01:28,038 DEBUG [RS:1;jenkins-hbase9:35905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:28,038 INFO [RS:1;jenkins-hbase9:35905] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:28,038 INFO [RS:1;jenkins-hbase9:35905] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:28,040 INFO [RS:1;jenkins-hbase9:35905] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35905 2023-02-17 22:01:28,040 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:28,043 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35905,1676671284215 2023-02-17 22:01:28,043 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:28,043 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cc39004 rejected from java.util.concurrent.ThreadPoolExecutor@18fc1744[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,044 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35905,1676671284215] 2023-02-17 22:01:28,044 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35905,1676671284215; numProcessing=2 2023-02-17 22:01:28,046 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35905,1676671284215 already deleted, retry=false 2023-02-17 22:01:28,046 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35905,1676671284215 expired; onlineServers=0 2023-02-17 22:01:28,046 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,32997,1676671284148' ***** 2023-02-17 22:01:28,046 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:28,047 DEBUG [M:0;jenkins-hbase9:32997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@352eb1d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:28,047 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,32997,1676671284148 2023-02-17 22:01:28,047 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,32997,1676671284148; all regions closed. 2023-02-17 22:01:28,047 DEBUG [M:0;jenkins-hbase9:32997] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:28,047 DEBUG [M:0;jenkins-hbase9:32997] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:28,047 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:28,047 DEBUG [M:0;jenkins-hbase9:32997] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:28,047 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671284790] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671284790,5,FailOnTimeoutGroup] 2023-02-17 22:01:28,047 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671284790] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671284790,5,FailOnTimeoutGroup] 2023-02-17 22:01:28,047 INFO [M:0;jenkins-hbase9:32997] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:28,048 INFO [M:0;jenkins-hbase9:32997] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:28,048 INFO [M:0;jenkins-hbase9:32997] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:28,048 DEBUG [M:0;jenkins-hbase9:32997] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:28,048 INFO [M:0;jenkins-hbase9:32997] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:28,049 ERROR [M:0;jenkins-hbase9:32997] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 22:01:28,049 INFO [M:0;jenkins-hbase9:32997] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:28,049 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:28,052 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:28,052 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:28,052 DEBUG [M:0;jenkins-hbase9:32997] zookeeper.ZKUtil(398): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:28,052 WARN [M:0;jenkins-hbase9:32997] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:28,052 INFO [M:0;jenkins-hbase9:32997] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:28,052 INFO [M:0;jenkins-hbase9:32997] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:28,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:28,053 DEBUG [M:0;jenkins-hbase9:32997] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:28,053 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:28,053 DEBUG [M:0;jenkins-hbase9:32997] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:28,053 DEBUG [M:0;jenkins-hbase9:32997] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:28,053 DEBUG [M:0;jenkins-hbase9:32997] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:28,053 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.86 KB 2023-02-17 22:01:28,069 INFO [M:0;jenkins-hbase9:32997] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b71e5757251c4edfbff97241e70600f8 2023-02-17 22:01:28,074 DEBUG [M:0;jenkins-hbase9:32997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b71e5757251c4edfbff97241e70600f8 as hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b71e5757251c4edfbff97241e70600f8 2023-02-17 22:01:28,079 INFO [M:0;jenkins-hbase9:32997] regionserver.HStore(1080): Added hdfs://localhost:34849/user/jenkins/test-data/a1a03b50-d02b-2185-9214-32356aa55b6d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b71e5757251c4edfbff97241e70600f8, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 22:01:28,080 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57252, heapSize ~66.84 KB/68448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=132, compaction requested=false 2023-02-17 22:01:28,083 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:28,083 DEBUG [M:0;jenkins-hbase9:32997] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:28,087 INFO [M:0;jenkins-hbase9:32997] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:28,087 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:28,088 INFO [M:0;jenkins-hbase9:32997] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:32997 2023-02-17 22:01:28,089 DEBUG [M:0;jenkins-hbase9:32997] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,32997,1676671284148 already deleted, retry=false 2023-02-17 22:01:28,204 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:28,204 INFO [M:0;jenkins-hbase9:32997] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,32997,1676671284148; zookeeper connection closed. 2023-02-17 22:01:28,204 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@509b481d rejected from java.util.concurrent.ThreadPoolExecutor@54a4d6d6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,206 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): master:32997-0x100644e53920000, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:28,206 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2aac6c39 rejected from java.util.concurrent.ThreadPoolExecutor@54a4d6d6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,304 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:28,304 INFO [RS:1;jenkins-hbase9:35905] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35905,1676671284215; zookeeper connection closed. 2023-02-17 22:01:28,304 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6caaa868 rejected from java.util.concurrent.ThreadPoolExecutor@18fc1744[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,304 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c8bdf00] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c8bdf00 2023-02-17 22:01:28,304 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:35905-0x100644e53920002, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:28,305 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14572aa7 rejected from java.util.concurrent.ThreadPoolExecutor@18fc1744[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,364 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:28,404 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:28,404 INFO [RS:0;jenkins-hbase9:46531] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,46531,1676671284193; zookeeper connection closed. 2023-02-17 22:01:28,404 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68267403 rejected from java.util.concurrent.ThreadPoolExecutor@4c0c8cda[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,404 DEBUG [Listener at localhost/34935-EventThread] zookeeper.ZKWatcher(600): regionserver:46531-0x100644e53920001, quorum=127.0.0.1:57146, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:28,405 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40abb3d6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40abb3d6 2023-02-17 22:01:28,405 ERROR [Listener at localhost/34935-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@100fc2ad rejected from java.util.concurrent.ThreadPoolExecutor@4c0c8cda[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:28,405 INFO [Listener at localhost/34935] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:28,405 WARN [Listener at localhost/34935] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:28,409 INFO [Listener at localhost/34935] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:28,514 WARN [BP-2146282456-172.31.2.10-1676671283547 heartbeating to localhost/127.0.0.1:34849] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:28,515 WARN [BP-2146282456-172.31.2.10-1676671283547 heartbeating to localhost/127.0.0.1:34849] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2146282456-172.31.2.10-1676671283547 (Datanode Uuid 0ee8baf6-f55e-4a3f-858f-4763394eb81d) service to localhost/127.0.0.1:34849 2023-02-17 22:01:28,516 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/dfs/data/data3/current/BP-2146282456-172.31.2.10-1676671283547] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:28,516 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/dfs/data/data4/current/BP-2146282456-172.31.2.10-1676671283547] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:28,518 WARN [Listener at localhost/34935] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:28,524 INFO [Listener at localhost/34935] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:28,629 WARN [BP-2146282456-172.31.2.10-1676671283547 heartbeating to localhost/127.0.0.1:34849] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:28,629 WARN [BP-2146282456-172.31.2.10-1676671283547 heartbeating to localhost/127.0.0.1:34849] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2146282456-172.31.2.10-1676671283547 (Datanode Uuid 55dfa2fd-d9b7-4acc-8d09-8f29ac3c6fa0) service to localhost/127.0.0.1:34849 2023-02-17 22:01:28,629 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/dfs/data/data1/current/BP-2146282456-172.31.2.10-1676671283547] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:28,630 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/cluster_c1601382-4130-fbfb-8f9a-42b1af8468c6/dfs/data/data2/current/BP-2146282456-172.31.2.10-1676671283547] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:28,641 INFO [Listener at localhost/34935] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:28,762 INFO [Listener at localhost/34935] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:28,796 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:28,811 INFO [Listener at localhost/34935] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=176 (was 154) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:34849 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34935 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,32997,1676671284148)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:34849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:34849 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:34849 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34849 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:34849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:34849 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=567 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 324), ProcessCount=173 (was 173), AvailableMemoryMB=6869 (was 6915) 2023-02-17 22:01:28,821 INFO [Listener at localhost/34935] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=176, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=173, AvailableMemoryMB=6868 2023-02-17 22:01:28,832 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/hadoop.log.dir so I do NOT create it in target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b 2023-02-17 22:01:28,832 WARN [Listener at localhost/34935] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 22:01:28,832 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/hadoop.tmp.dir so I do NOT create it in target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b 2023-02-17 22:01:28,832 WARN [Listener at localhost/34935] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e3a9213c-3950-fa6a-8391-bd3ef9278890/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 22:01:28,832 DEBUG [Listener at localhost/34935] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b 2023-02-17 22:01:28,832 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:01:28,832 INFO [Listener at localhost/34935] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58, deleteOnExit=true 2023-02-17 22:01:28,832 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:01:28,832 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/test.cache.data in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:01:28,833 DEBUG [Listener at localhost/34935] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:28,833 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:01:28,834 INFO [Listener at localhost/34935] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:01:28,838 WARN [Listener at localhost/34935] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:28,838 WARN [Listener at localhost/34935] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:28,891 WARN [Listener at localhost/34935] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:28,894 INFO [Listener at localhost/34935] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:28,907 INFO [Listener at localhost/34935] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/java.io.tmpdir/Jetty_localhost_36925_hdfs____.61yo9p/webapp 2023-02-17 22:01:29,003 INFO [Listener at localhost/34935] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36925 2023-02-17 22:01:29,008 WARN [Listener at localhost/34935] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:29,008 WARN [Listener at localhost/34935] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:29,052 WARN [Listener at localhost/46207] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:29,063 WARN [Listener at localhost/46207] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:29,067 WARN [Listener at localhost/46207] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:29,068 INFO [Listener at localhost/46207] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:29,074 INFO [Listener at localhost/46207] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/java.io.tmpdir/Jetty_localhost_35151_datanode____.25hnzi/webapp 2023-02-17 22:01:29,177 INFO [Listener at localhost/46207] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35151 2023-02-17 22:01:29,183 WARN [Listener at localhost/38671] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:29,197 WARN [Listener at localhost/38671] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:29,200 WARN [Listener at localhost/38671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:29,201 INFO [Listener at localhost/38671] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:29,207 INFO [Listener at localhost/38671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/java.io.tmpdir/Jetty_localhost_39683_datanode____.h30dn2/webapp 2023-02-17 22:01:29,277 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a9d188218f4dca: Processing first storage report for DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1 from datanode 32491a28-6e79-4586-b068-70bf57f5af79 2023-02-17 22:01:29,278 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a9d188218f4dca: from storage DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1 node DatanodeRegistration(127.0.0.1:36045, datanodeUuid=32491a28-6e79-4586-b068-70bf57f5af79, infoPort=37617, infoSecurePort=0, ipcPort=38671, storageInfo=lv=-57;cid=testClusterID;nsid=129102778;c=1676671288841), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:29,278 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a9d188218f4dca: Processing first storage report for DS-7ef3473c-1050-4776-b08e-810a16378bcc from datanode 32491a28-6e79-4586-b068-70bf57f5af79 2023-02-17 22:01:29,278 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a9d188218f4dca: from storage DS-7ef3473c-1050-4776-b08e-810a16378bcc node DatanodeRegistration(127.0.0.1:36045, datanodeUuid=32491a28-6e79-4586-b068-70bf57f5af79, infoPort=37617, infoSecurePort=0, ipcPort=38671, storageInfo=lv=-57;cid=testClusterID;nsid=129102778;c=1676671288841), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:29,319 INFO [Listener at localhost/38671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39683 2023-02-17 22:01:29,331 WARN [Listener at localhost/37939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:29,449 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9bc29dd5aaa87a49: Processing first storage report for DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8 from datanode c8ac3264-d7c7-47de-b0b2-03b014ece1b6 2023-02-17 22:01:29,449 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9bc29dd5aaa87a49: from storage DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8 node DatanodeRegistration(127.0.0.1:40223, datanodeUuid=c8ac3264-d7c7-47de-b0b2-03b014ece1b6, infoPort=42671, infoSecurePort=0, ipcPort=37939, storageInfo=lv=-57;cid=testClusterID;nsid=129102778;c=1676671288841), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:29,449 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9bc29dd5aaa87a49: Processing first storage report for DS-6c047bbe-76e7-4f79-9361-31cea8c299a9 from datanode c8ac3264-d7c7-47de-b0b2-03b014ece1b6 2023-02-17 22:01:29,449 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9bc29dd5aaa87a49: from storage DS-6c047bbe-76e7-4f79-9361-31cea8c299a9 node DatanodeRegistration(127.0.0.1:40223, datanodeUuid=c8ac3264-d7c7-47de-b0b2-03b014ece1b6, infoPort=42671, infoSecurePort=0, ipcPort=37939, storageInfo=lv=-57;cid=testClusterID;nsid=129102778;c=1676671288841), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:29,466 DEBUG [Listener at localhost/37939] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b 2023-02-17 22:01:29,494 INFO [Listener at localhost/37939] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/zookeeper_0, clientPort=58480, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:01:29,495 INFO [Listener at localhost/37939] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58480 2023-02-17 22:01:29,495 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,496 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,570 INFO [Listener at localhost/37939] util.FSUtils(479): Created version file at hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866 with version=8 2023-02-17 22:01:29,570 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,571 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,573 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/hbase-staging 2023-02-17 22:01:29,575 INFO [Listener at localhost/37939] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:29,575 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,575 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,576 INFO [Listener at localhost/37939] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:29,576 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,576 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:29,576 INFO [Listener at localhost/37939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:29,581 INFO [Listener at localhost/37939] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35957 2023-02-17 22:01:29,581 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,582 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,583 INFO [Listener at localhost/37939] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35957 connecting to ZooKeeper ensemble=127.0.0.1:58480 2023-02-17 22:01:29,593 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:359570x0, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:29,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35957-0x100644e68830000 connected 2023-02-17 22:01:29,623 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:29,623 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:29,624 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:29,625 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35957 2023-02-17 22:01:29,627 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35957 2023-02-17 22:01:29,627 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35957 2023-02-17 22:01:29,627 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35957 2023-02-17 22:01:29,628 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35957 2023-02-17 22:01:29,628 INFO [Listener at localhost/37939] master.HMaster(444): hbase.rootdir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866, hbase.cluster.distributed=false 2023-02-17 22:01:29,640 INFO [Listener at localhost/37939] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:29,640 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,640 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,640 INFO [Listener at localhost/37939] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:29,641 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,641 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:29,641 INFO [Listener at localhost/37939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:29,641 INFO [Listener at localhost/37939] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45431 2023-02-17 22:01:29,642 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:29,643 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:29,643 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,644 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,645 INFO [Listener at localhost/37939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45431 connecting to ZooKeeper ensemble=127.0.0.1:58480 2023-02-17 22:01:29,648 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:454310x0, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:29,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45431-0x100644e68830001 connected 2023-02-17 22:01:29,649 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:29,650 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:29,650 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:29,651 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45431 2023-02-17 22:01:29,651 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45431 2023-02-17 22:01:29,651 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45431 2023-02-17 22:01:29,653 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45431 2023-02-17 22:01:29,653 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45431 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:29,664 INFO [Listener at localhost/37939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:29,665 INFO [Listener at localhost/37939] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35117 2023-02-17 22:01:29,665 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:29,666 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:29,666 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,667 INFO [Listener at localhost/37939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,668 INFO [Listener at localhost/37939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35117 connecting to ZooKeeper ensemble=127.0.0.1:58480 2023-02-17 22:01:29,671 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:351170x0, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:29,672 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): regionserver:351170x0, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:29,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35117-0x100644e68830002 connected 2023-02-17 22:01:29,673 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:29,673 DEBUG [Listener at localhost/37939] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:29,673 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35117 2023-02-17 22:01:29,674 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35117 2023-02-17 22:01:29,674 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35117 2023-02-17 22:01:29,674 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35117 2023-02-17 22:01:29,674 DEBUG [Listener at localhost/37939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35117 2023-02-17 22:01:29,678 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,681 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:29,681 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,682 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:29,682 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:29,682 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:29,683 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:29,684 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:29,685 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35957,1676671289575 from backup master directory 2023-02-17 22:01:29,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:29,686 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,686 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:29,686 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:29,686 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,696 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/hbase.id with ID: 673c7151-642e-437a-a196-d4e451a8c5e2 2023-02-17 22:01:29,705 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:29,708 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:29,715 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x51fcd95e to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:29,720 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11a2e112, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:29,721 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:29,721 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:01:29,721 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:29,722 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store-tmp 2023-02-17 22:01:29,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:29,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:29,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:29,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:29,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:29,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:29,728 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:29,728 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:29,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/WALs/jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,731 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35957%2C1676671289575, suffix=, logDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/WALs/jenkins-hbase9.apache.org,35957,1676671289575, archiveDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:29,745 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK] 2023-02-17 22:01:29,746 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK] 2023-02-17 22:01:29,748 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/WALs/jenkins-hbase9.apache.org,35957,1676671289575/jenkins-hbase9.apache.org%2C35957%2C1676671289575.1676671289731 2023-02-17 22:01:29,748 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK], DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK]] 2023-02-17 22:01:29,748 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:29,748 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:29,748 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:29,748 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:29,750 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:29,752 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:29,753 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:29,753 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:29,755 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:29,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:29,763 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:29,765 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:29,766 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61183950, jitterRate=-0.08828809857368469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:29,766 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:29,766 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:29,767 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:29,767 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:29,767 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:29,769 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-17 22:01:29,769 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 22:01:29,769 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:29,771 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:29,772 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:29,785 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:29,785 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:29,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:29,786 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:29,786 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:29,788 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:29,789 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:29,789 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:29,790 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:29,792 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:29,792 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:29,792 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:29,792 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:29,792 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,35957,1676671289575, sessionid=0x100644e68830000, setting cluster-up flag (Was=false) 2023-02-17 22:01:29,798 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:29,802 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:29,803 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,807 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:29,813 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:29,814 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:29,815 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.hbase-snapshot/.tmp 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,817 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:29,818 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,823 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671319823 2023-02-17 22:01:29,823 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:29,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:29,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:29,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:29,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:29,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:29,827 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,827 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:29,827 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:29,827 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:29,828 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:29,828 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:29,828 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:29,828 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:29,828 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671289828,5,FailOnTimeoutGroup] 2023-02-17 22:01:29,829 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:29,829 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671289828,5,FailOnTimeoutGroup] 2023-02-17 22:01:29,829 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,829 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:29,829 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,829 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,846 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:29,846 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:29,847 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866 2023-02-17 22:01:29,858 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:29,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:29,864 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/info 2023-02-17 22:01:29,865 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:29,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:29,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:29,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:29,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:29,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:29,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:29,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/table 2023-02-17 22:01:29,868 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:29,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:29,869 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740 2023-02-17 22:01:29,870 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740 2023-02-17 22:01:29,871 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:29,872 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:29,874 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66358656, jitterRate=-0.011178970336914062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:29,874 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:29,874 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:29,874 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:29,879 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:29,879 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:29,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:29,880 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(952): ClusterId : 673c7151-642e-437a-a196-d4e451a8c5e2 2023-02-17 22:01:29,880 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(952): ClusterId : 673c7151-642e-437a-a196-d4e451a8c5e2 2023-02-17 22:01:29,880 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:29,880 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:29,881 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:29,883 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:29,883 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:29,883 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:29,883 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:29,883 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:29,886 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:29,887 DEBUG [RS:0;jenkins-hbase9:45431] zookeeper.ReadOnlyZKClient(139): Connect 0x30cdc088 to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:29,888 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:29,889 DEBUG [RS:1;jenkins-hbase9:35117] zookeeper.ReadOnlyZKClient(139): Connect 0x4c73689a to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:29,895 DEBUG [RS:0;jenkins-hbase9:45431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e0a38e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:29,895 DEBUG [RS:0;jenkins-hbase9:45431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a35abf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:29,895 DEBUG [RS:1;jenkins-hbase9:35117] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42b48f64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:29,895 DEBUG [RS:1;jenkins-hbase9:35117] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@468b03ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:29,903 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:45431 2023-02-17 22:01:29,904 INFO [RS:0;jenkins-hbase9:45431] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:29,904 INFO [RS:0;jenkins-hbase9:45431] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:29,904 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:29,904 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35957,1676671289575 with isa=jenkins-hbase9.apache.org/172.31.2.10:45431, startcode=1676671289640 2023-02-17 22:01:29,904 DEBUG [RS:0;jenkins-hbase9:45431] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:29,906 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:35117 2023-02-17 22:01:29,906 INFO [RS:1;jenkins-hbase9:35117] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:29,906 INFO [RS:1;jenkins-hbase9:35117] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:29,906 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:29,906 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40249, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:29,906 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,35957,1676671289575 with isa=jenkins-hbase9.apache.org/172.31.2.10:35117, startcode=1676671289663 2023-02-17 22:01:29,906 DEBUG [RS:1;jenkins-hbase9:35117] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:29,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,909 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866 2023-02-17 22:01:29,909 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46207 2023-02-17 22:01:29,909 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:29,909 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57233, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:29,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,910 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866 2023-02-17 22:01:29,910 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46207 2023-02-17 22:01:29,910 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:29,910 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:29,911 DEBUG [RS:0;jenkins-hbase9:45431] zookeeper.ZKUtil(162): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,911 WARN [RS:0;jenkins-hbase9:45431] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:29,911 INFO [RS:0;jenkins-hbase9:45431] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:29,911 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45431,1676671289640] 2023-02-17 22:01:29,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35117,1676671289663] 2023-02-17 22:01:29,916 DEBUG [RS:1;jenkins-hbase9:35117] zookeeper.ZKUtil(162): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,917 WARN [RS:1;jenkins-hbase9:35117] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:29,917 INFO [RS:1;jenkins-hbase9:35117] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:29,917 DEBUG [RS:0;jenkins-hbase9:45431] zookeeper.ZKUtil(162): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,917 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,917 DEBUG [RS:0;jenkins-hbase9:45431] zookeeper.ZKUtil(162): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,919 DEBUG [RS:0;jenkins-hbase9:45431] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:29,919 INFO [RS:0;jenkins-hbase9:45431] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:29,920 DEBUG [RS:1;jenkins-hbase9:35117] zookeeper.ZKUtil(162): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,921 DEBUG [RS:1;jenkins-hbase9:35117] zookeeper.ZKUtil(162): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,921 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:29,922 INFO [RS:1;jenkins-hbase9:35117] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:29,923 INFO [RS:0;jenkins-hbase9:45431] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:29,923 INFO [RS:1;jenkins-hbase9:35117] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:29,923 INFO [RS:0;jenkins-hbase9:45431] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:29,923 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,923 INFO [RS:1;jenkins-hbase9:35117] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:29,923 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,923 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:29,927 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:29,928 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,928 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:29,928 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,928 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,929 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,929 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,929 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,929 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,929 DEBUG [RS:1;jenkins-hbase9:35117] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,929 DEBUG [RS:0;jenkins-hbase9:45431] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:29,932 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,932 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,932 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,935 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,935 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,935 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,946 INFO [RS:0;jenkins-hbase9:45431] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:29,946 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45431,1676671289640-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,949 INFO [RS:1;jenkins-hbase9:35117] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:29,949 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35117,1676671289663-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:29,958 INFO [RS:0;jenkins-hbase9:45431] regionserver.Replication(203): jenkins-hbase9.apache.org,45431,1676671289640 started 2023-02-17 22:01:29,958 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,45431,1676671289640, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45431, sessionid=0x100644e68830001 2023-02-17 22:01:29,958 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:29,958 DEBUG [RS:0;jenkins-hbase9:45431] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,958 DEBUG [RS:0;jenkins-hbase9:45431] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45431,1676671289640' 2023-02-17 22:01:29,958 DEBUG [RS:0;jenkins-hbase9:45431] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:29,958 DEBUG [RS:0;jenkins-hbase9:45431] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45431,1676671289640' 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:29,959 DEBUG [RS:0;jenkins-hbase9:45431] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:29,959 INFO [RS:0;jenkins-hbase9:45431] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:29,959 INFO [RS:0;jenkins-hbase9:45431] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:29,966 INFO [RS:1;jenkins-hbase9:35117] regionserver.Replication(203): jenkins-hbase9.apache.org,35117,1676671289663 started 2023-02-17 22:01:29,966 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,35117,1676671289663, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35117, sessionid=0x100644e68830002 2023-02-17 22:01:29,966 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:29,966 DEBUG [RS:1;jenkins-hbase9:35117] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,966 DEBUG [RS:1;jenkins-hbase9:35117] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35117,1676671289663' 2023-02-17 22:01:29,966 DEBUG [RS:1;jenkins-hbase9:35117] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35117,1676671289663' 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:29,967 DEBUG [RS:1;jenkins-hbase9:35117] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:29,968 DEBUG [RS:1;jenkins-hbase9:35117] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:29,968 INFO [RS:1;jenkins-hbase9:35117] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:29,968 INFO [RS:1;jenkins-hbase9:35117] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:30,033 DEBUG [jenkins-hbase9:35957] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:30,033 DEBUG [jenkins-hbase9:35957] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:30,035 DEBUG [jenkins-hbase9:35957] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:30,035 DEBUG [jenkins-hbase9:35957] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:30,035 DEBUG [jenkins-hbase9:35957] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:30,036 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35117,1676671289663, state=OPENING 2023-02-17 22:01:30,038 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:30,039 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:30,040 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:30,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:30,195 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:30,195 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:30,197 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33578, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:30,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:30,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:30,202 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35117%2C1676671289663.meta, suffix=.meta, logDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,35117,1676671289663, archiveDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/oldWALs, maxLogs=32 2023-02-17 22:01:30,217 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK] 2023-02-17 22:01:30,217 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK] 2023-02-17 22:01:30,219 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,35117,1676671289663/jenkins-hbase9.apache.org%2C35117%2C1676671289663.meta.1676671290203.meta 2023-02-17 22:01:30,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK], DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK]] 2023-02-17 22:01:30,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:30,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:30,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:30,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:30,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:30,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:30,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:30,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:30,222 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/info 2023-02-17 22:01:30,222 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/info 2023-02-17 22:01:30,222 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:30,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:30,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:30,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:30,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:30,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:30,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:30,224 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:30,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/table 2023-02-17 22:01:30,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/table 2023-02-17 22:01:30,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:30,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:30,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740 2023-02-17 22:01:30,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740 2023-02-17 22:01:30,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:30,230 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:30,231 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71687543, jitterRate=0.06822763383388519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:30,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:30,232 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671290195 2023-02-17 22:01:30,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:30,238 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:30,238 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35117,1676671289663, state=OPEN 2023-02-17 22:01:30,240 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:30,240 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:30,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:30,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35117,1676671289663 in 200 msec 2023-02-17 22:01:30,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:30,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-17 22:01:30,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 427 msec 2023-02-17 22:01:30,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671290244, completionTime=-1 2023-02-17 22:01:30,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:30,245 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:30,247 DEBUG [hconnection-0x7c958ecc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:30,248 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:30,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:30,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671350250 2023-02-17 22:01:30,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671410250 2023-02-17 22:01:30,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35957,1676671289575-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35957,1676671289575-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35957,1676671289575-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35957, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:30,257 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:30,258 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:30,258 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:30,259 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:30,259 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:30,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001 empty. 2023-02-17 22:01:30,262 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,262 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:30,274 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:30,275 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d350442a2642ac17dfb6fbaa2a04e001, NAME => 'hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,285 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,285 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d350442a2642ac17dfb6fbaa2a04e001, disabling compactions & flushes 2023-02-17 22:01:30,285 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,285 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,285 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. after waiting 0 ms 2023-02-17 22:01:30,285 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,285 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,285 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d350442a2642ac17dfb6fbaa2a04e001: 2023-02-17 22:01:30,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:30,288 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671290288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290288"}]},"ts":"1676671290288"} 2023-02-17 22:01:30,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:30,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:30,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671290292"}]},"ts":"1676671290292"} 2023-02-17 22:01:30,293 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:30,297 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:30,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:30,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:30,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:30,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d350442a2642ac17dfb6fbaa2a04e001, ASSIGN}] 2023-02-17 22:01:30,304 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d350442a2642ac17dfb6fbaa2a04e001, ASSIGN 2023-02-17 22:01:30,305 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d350442a2642ac17dfb6fbaa2a04e001, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35117,1676671289663; forceNewPlan=false, retain=false 2023-02-17 22:01:30,455 INFO [jenkins-hbase9:35957] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:30,456 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d350442a2642ac17dfb6fbaa2a04e001, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:30,456 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671290456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671290456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671290456"}]},"ts":"1676671290456"} 2023-02-17 22:01:30,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d350442a2642ac17dfb6fbaa2a04e001, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:30,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,615 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35117%2C1676671289663, suffix=, logDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,35117,1676671289663, archiveDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/oldWALs, maxLogs=32 2023-02-17 22:01:30,630 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK] 2023-02-17 22:01:30,630 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK] 2023-02-17 22:01:30,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,35117,1676671289663/jenkins-hbase9.apache.org%2C35117%2C1676671289663.1676671290616 2023-02-17 22:01:30,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK], DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK]] 2023-02-17 22:01:30,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d350442a2642ac17dfb6fbaa2a04e001, NAME => 'hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:30,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,635 INFO [StoreOpener-d350442a2642ac17dfb6fbaa2a04e001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,636 DEBUG [StoreOpener-d350442a2642ac17dfb6fbaa2a04e001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/info 2023-02-17 22:01:30,636 DEBUG [StoreOpener-d350442a2642ac17dfb6fbaa2a04e001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/info 2023-02-17 22:01:30,636 INFO [StoreOpener-d350442a2642ac17dfb6fbaa2a04e001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d350442a2642ac17dfb6fbaa2a04e001 columnFamilyName info 2023-02-17 22:01:30,637 INFO [StoreOpener-d350442a2642ac17dfb6fbaa2a04e001-1] regionserver.HStore(310): Store=d350442a2642ac17dfb6fbaa2a04e001/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:30,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,640 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:30,641 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:30,642 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d350442a2642ac17dfb6fbaa2a04e001; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72118599, jitterRate=0.07465086877346039}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:30,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d350442a2642ac17dfb6fbaa2a04e001: 2023-02-17 22:01:30,643 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001., pid=6, masterSystemTime=1676671290611 2023-02-17 22:01:30,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,645 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:30,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d350442a2642ac17dfb6fbaa2a04e001, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:30,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671290645"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671290645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671290645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671290645"}]},"ts":"1676671290645"} 2023-02-17 22:01:30,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:30,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d350442a2642ac17dfb6fbaa2a04e001, server=jenkins-hbase9.apache.org,35117,1676671289663 in 188 msec 2023-02-17 22:01:30,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:30,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d350442a2642ac17dfb6fbaa2a04e001, ASSIGN in 350 msec 2023-02-17 22:01:30,650 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:30,650 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671290650"}]},"ts":"1676671290650"} 2023-02-17 22:01:30,651 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:30,653 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:30,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 396 msec 2023-02-17 22:01:30,657 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 22:01:30,659 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:30,663 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:30,663 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:30,667 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:30,679 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:30,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-17 22:01:30,689 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:30,696 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:30,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-17 22:01:30,713 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:30,717 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:30,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.031sec 2023-02-17 22:01:30,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:30,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:30,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:30,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35957,1676671289575-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:30,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35957,1676671289575-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:30,720 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:30,780 DEBUG [Listener at localhost/37939] zookeeper.ReadOnlyZKClient(139): Connect 0x7b67dd44 to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:30,786 DEBUG [Listener at localhost/37939] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40811ad4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:30,788 DEBUG [hconnection-0x6308ec50-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:30,790 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:30,791 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:30,791 DEBUG [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:30,793 DEBUG [Listener at localhost/37939] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:30,795 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:30,795 INFO [Listener at localhost/37939] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-17 22:01:30,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceMultiRegion 2023-02-17 22:01:30,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:30,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.2.10:42050 deadline: 1676671350796, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-17 22:01:30,796 INFO [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-17 22:01:30,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:30,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:30,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:30,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-17 22:01:30,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:30,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:30,809 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 empty. 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 empty. 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 empty. 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 empty. 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae empty. 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:30,810 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 empty. 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 empty. 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:30,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:30,812 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:30,812 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb empty. 2023-02-17 22:01:30,812 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec empty. 2023-02-17 22:01:30,812 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 empty. 2023-02-17 22:01:30,812 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:30,812 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:30,813 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:30,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-17 22:01:30,825 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:30,827 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0418ab664c892c2595c8d9aec2d31305, NAME => 'testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,827 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1c6f8fceaaceac68b610dc7f69083f25, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,827 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,842 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,842 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 0418ab664c892c2595c8d9aec2d31305, disabling compactions & flushes 2023-02-17 22:01:30,842 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:30,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:30,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. after waiting 0 ms 2023-02-17 22:01:30,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:30,843 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:30,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:30,843 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae3e5b9276c4b2ce0829f48ae5047078, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, disabling compactions & flushes 2023-02-17 22:01:30,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:30,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:30,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. after waiting 0 ms 2023-02-17 22:01:30,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:30,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:30,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:30,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2c75ba8309d7fb83e9c48f0c33154468, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 1c6f8fceaaceac68b610dc7f69083f25, disabling compactions & flushes 2023-02-17 22:01:30,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:30,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:30,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. after waiting 0 ms 2023-02-17 22:01:30,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:30,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:30,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:30,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0c80d785b8b0fee20fae3c6c1bb123ae, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,871 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 2c75ba8309d7fb83e9c48f0c33154468, disabling compactions & flushes 2023-02-17 22:01:30,872 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:30,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:30,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. after waiting 0 ms 2023-02-17 22:01:30,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:30,872 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:30,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:30,872 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => ca3415a69d18dcbc6206c6bd541b8095, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,875 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,875 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ae3e5b9276c4b2ce0829f48ae5047078, disabling compactions & flushes 2023-02-17 22:01:30,875 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:30,875 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:30,875 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. after waiting 0 ms 2023-02-17 22:01:30,875 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:30,875 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:30,876 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:30,876 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6afee56be47150e82bd109b76cca52fb, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,879 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,879 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 0c80d785b8b0fee20fae3c6c1bb123ae, disabling compactions & flushes 2023-02-17 22:01:30,879 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:30,879 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:30,879 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. after waiting 0 ms 2023-02-17 22:01:30,879 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:30,879 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:30,879 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:30,880 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5a854a172d2e2ac6742c4c282ae7c0ec, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,903 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,903 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing ca3415a69d18dcbc6206c6bd541b8095, disabling compactions & flushes 2023-02-17 22:01:30,903 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:30,903 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:30,903 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. after waiting 0 ms 2023-02-17 22:01:30,903 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:30,903 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:30,903 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:30,904 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e769228ddcfcd2e056e78afd36bf36c1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp 2023-02-17 22:01:30,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:30,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 6afee56be47150e82bd109b76cca52fb, disabling compactions & flushes 2023-02-17 22:01:30,910 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:30,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:30,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. after waiting 0 ms 2023-02-17 22:01:30,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:30,910 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:30,910 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:30,915 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,915 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 5a854a172d2e2ac6742c4c282ae7c0ec, disabling compactions & flushes 2023-02-17 22:01:30,915 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:30,915 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:30,915 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. after waiting 0 ms 2023-02-17 22:01:30,915 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:30,915 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:30,915 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:30,919 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:30,919 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e769228ddcfcd2e056e78afd36bf36c1, disabling compactions & flushes 2023-02-17 22:01:30,919 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:30,919 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:30,919 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. after waiting 0 ms 2023-02-17 22:01:30,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:30,920 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:30,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:30,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:30,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,923 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671290922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671290922"}]},"ts":"1676671290922"} 2023-02-17 22:01:30,925 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 22:01:30,926 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:30,926 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671290926"}]},"ts":"1676671290926"} 2023-02-17 22:01:30,927 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-17 22:01:30,931 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:30,937 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:30,937 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:30,937 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:30,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, ASSIGN}] 2023-02-17 22:01:30,939 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, ASSIGN 2023-02-17 22:01:30,940 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, ASSIGN 2023-02-17 22:01:30,940 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, ASSIGN 2023-02-17 22:01:30,940 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, ASSIGN 2023-02-17 22:01:30,940 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45431,1676671289640; forceNewPlan=false, retain=false 2023-02-17 22:01:30,940 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35117,1676671289663; forceNewPlan=false, retain=false 2023-02-17 22:01:30,940 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45431,1676671289640; forceNewPlan=false, retain=false 2023-02-17 22:01:30,940 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45431,1676671289640; forceNewPlan=false, retain=false 2023-02-17 22:01:30,940 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, ASSIGN 2023-02-17 22:01:30,941 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, ASSIGN 2023-02-17 22:01:30,941 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, ASSIGN 2023-02-17 22:01:30,941 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, ASSIGN 2023-02-17 22:01:30,941 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45431,1676671289640; forceNewPlan=false, retain=false 2023-02-17 22:01:30,941 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35117,1676671289663; forceNewPlan=false, retain=false 2023-02-17 22:01:30,941 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, ASSIGN 2023-02-17 22:01:30,942 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35117,1676671289663; forceNewPlan=false, retain=false 2023-02-17 22:01:30,942 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45431,1676671289640; forceNewPlan=false, retain=false 2023-02-17 22:01:30,942 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, ASSIGN 2023-02-17 22:01:30,943 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35117,1676671289663; forceNewPlan=false, retain=false 2023-02-17 22:01:30,943 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35117,1676671289663; forceNewPlan=false, retain=false 2023-02-17 22:01:30,961 INFO [RS:0;jenkins-hbase9:45431] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45431%2C1676671289640, suffix=, logDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,45431,1676671289640, archiveDir=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/oldWALs, maxLogs=32 2023-02-17 22:01:30,979 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK] 2023-02-17 22:01:30,980 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK] 2023-02-17 22:01:30,982 INFO [RS:0;jenkins-hbase9:45431] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/WALs/jenkins-hbase9.apache.org,45431,1676671289640/jenkins-hbase9.apache.org%2C45431%2C1676671289640.1676671290961 2023-02-17 22:01:30,982 DEBUG [RS:0;jenkins-hbase9:45431] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40223,DS-192670a6-bfb8-4b2b-83c2-886fc67ea6e8,DISK], DatanodeInfoWithStorage[127.0.0.1:36045,DS-3ca4b690-1a62-4ded-ac1b-319eda10e5e1,DISK]] 2023-02-17 22:01:31,090 INFO [jenkins-hbase9:35957] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 22:01:31,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=ca3415a69d18dcbc6206c6bd541b8095, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,096 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0418ab664c892c2595c8d9aec2d31305, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,096 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1c6f8fceaaceac68b610dc7f69083f25, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ae3e5b9276c4b2ce0829f48ae5047078, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5a854a172d2e2ac6742c4c282ae7c0ec, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,097 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291096"}]},"ts":"1676671291096"} 2023-02-17 22:01:31,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291096"}]},"ts":"1676671291096"} 2023-02-17 22:01:31,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291096"}]},"ts":"1676671291096"} 2023-02-17 22:01:31,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671291096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291096"}]},"ts":"1676671291096"} 2023-02-17 22:01:31,097 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291096"}]},"ts":"1676671291096"} 2023-02-17 22:01:31,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure ae3e5b9276c4b2ce0829f48ae5047078, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:31,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure 5a854a172d2e2ac6742c4c282ae7c0ec, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:31,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 1c6f8fceaaceac68b610dc7f69083f25, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:31,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 0418ab664c892c2595c8d9aec2d31305, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:31,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure ca3415a69d18dcbc6206c6bd541b8095, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:31,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e769228ddcfcd2e056e78afd36bf36c1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,102 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671291102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291102"}]},"ts":"1676671291102"} 2023-02-17 22:01:31,102 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0c80d785b8b0fee20fae3c6c1bb123ae, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291102"}]},"ts":"1676671291102"} 2023-02-17 22:01:31,103 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,103 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2c75ba8309d7fb83e9c48f0c33154468, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291103"}]},"ts":"1676671291103"} 2023-02-17 22:01:31,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure e769228ddcfcd2e056e78afd36bf36c1, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:31,104 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291103"}]},"ts":"1676671291103"} 2023-02-17 22:01:31,104 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=6afee56be47150e82bd109b76cca52fb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 0c80d785b8b0fee20fae3c6c1bb123ae, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:31,104 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671291104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671291104"}]},"ts":"1676671291104"} 2023-02-17 22:01:31,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:31,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure 2c75ba8309d7fb83e9c48f0c33154468, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:31,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 6afee56be47150e82bd109b76cca52fb, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:31,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:31,250 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,251 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:31,252 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48494, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:31,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:31,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1c6f8fceaaceac68b610dc7f69083f25, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 22:01:31,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,257 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:31,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0c80d785b8b0fee20fae3c6c1bb123ae, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 22:01:31,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,258 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1 2023-02-17 22:01:31,258 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1 2023-02-17 22:01:31,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,259 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6f8fceaaceac68b610dc7f69083f25 columnFamilyName f1 2023-02-17 22:01:31,259 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(310): Store=1c6f8fceaaceac68b610dc7f69083f25/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,259 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,259 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,260 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2 2023-02-17 22:01:31,260 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1 2023-02-17 22:01:31,260 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1 2023-02-17 22:01:31,260 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2 2023-02-17 22:01:31,261 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c80d785b8b0fee20fae3c6c1bb123ae columnFamilyName f1 2023-02-17 22:01:31,261 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6f8fceaaceac68b610dc7f69083f25 columnFamilyName f2 2023-02-17 22:01:31,261 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(310): Store=0c80d785b8b0fee20fae3c6c1bb123ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,261 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,261 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(310): Store=1c6f8fceaaceac68b610dc7f69083f25/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,262 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2 2023-02-17 22:01:31,262 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2 2023-02-17 22:01:31,262 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c80d785b8b0fee20fae3c6c1bb123ae columnFamilyName f2 2023-02-17 22:01:31,263 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(310): Store=0c80d785b8b0fee20fae3c6c1bb123ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:31,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:31,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1c6f8fceaaceac68b610dc7f69083f25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65626387, jitterRate=-0.022090628743171692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:31,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25., pid=23, masterSystemTime=1676671291250 2023-02-17 22:01:31,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 0c80d785b8b0fee20fae3c6c1bb123ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59386215, jitterRate=-0.11507643759250641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:31,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae., pid=27, masterSystemTime=1676671291255 2023-02-17 22:01:31,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:31,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:31,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0418ab664c892c2595c8d9aec2d31305, NAME => 'testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 22:01:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,271 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1c6f8fceaaceac68b610dc7f69083f25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,271 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291271"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291271"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291271"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291271"}]},"ts":"1676671291271"} 2023-02-17 22:01:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:31,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:31,272 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0c80d785b8b0fee20fae3c6c1bb123ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e769228ddcfcd2e056e78afd36bf36c1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 22:01:31,272 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291272"}]},"ts":"1676671291272"} 2023-02-17 22:01:31,272 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,274 DEBUG [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f1 2023-02-17 22:01:31,274 DEBUG [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f1 2023-02-17 22:01:31,274 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0418ab664c892c2595c8d9aec2d31305 columnFamilyName f1 2023-02-17 22:01:31,274 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,275 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(310): Store=0418ab664c892c2595c8d9aec2d31305/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,275 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-17 22:01:31,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 1c6f8fceaaceac68b610dc7f69083f25, server=jenkins-hbase9.apache.org,45431,1676671289640 in 173 msec 2023-02-17 22:01:31,275 DEBUG [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f1 2023-02-17 22:01:31,276 DEBUG [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f1 2023-02-17 22:01:31,276 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e769228ddcfcd2e056e78afd36bf36c1 columnFamilyName f1 2023-02-17 22:01:31,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-17 22:01:31,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 0c80d785b8b0fee20fae3c6c1bb123ae, server=jenkins-hbase9.apache.org,35117,1676671289663 in 170 msec 2023-02-17 22:01:31,276 DEBUG [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f2 2023-02-17 22:01:31,276 DEBUG [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f2 2023-02-17 22:01:31,276 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(310): Store=e769228ddcfcd2e056e78afd36bf36c1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, ASSIGN in 338 msec 2023-02-17 22:01:31,277 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0418ab664c892c2595c8d9aec2d31305 columnFamilyName f2 2023-02-17 22:01:31,277 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, ASSIGN in 339 msec 2023-02-17 22:01:31,277 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(310): Store=0418ab664c892c2595c8d9aec2d31305/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,278 DEBUG [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f2 2023-02-17 22:01:31,278 DEBUG [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f2 2023-02-17 22:01:31,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,278 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e769228ddcfcd2e056e78afd36bf36c1 columnFamilyName f2 2023-02-17 22:01:31,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,278 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(310): Store=e769228ddcfcd2e056e78afd36bf36c1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:31,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:31,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 0418ab664c892c2595c8d9aec2d31305; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62854270, jitterRate=-0.06339839100837708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:31,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e769228ddcfcd2e056e78afd36bf36c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61888672, jitterRate=-0.07778692245483398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:31,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305., pid=24, masterSystemTime=1676671291250 2023-02-17 22:01:31,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1., pid=26, masterSystemTime=1676671291255 2023-02-17 22:01:31,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:31,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:31,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ae3e5b9276c4b2ce0829f48ae5047078, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 22:01:31,285 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0418ab664c892c2595c8d9aec2d31305, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671291285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291285"}]},"ts":"1676671291285"} 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 22:01:31,285 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e769228ddcfcd2e056e78afd36bf36c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,285 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671291285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291285"}]},"ts":"1676671291285"} 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,286 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,286 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,287 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1 2023-02-17 22:01:31,287 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1 2023-02-17 22:01:31,288 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae3e5b9276c4b2ce0829f48ae5047078 columnFamilyName f1 2023-02-17 22:01:31,288 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1 2023-02-17 22:01:31,288 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1 2023-02-17 22:01:31,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-17 22:01:31,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 0418ab664c892c2595c8d9aec2d31305, server=jenkins-hbase9.apache.org,45431,1676671289640 in 186 msec 2023-02-17 22:01:31,288 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 columnFamilyName f1 2023-02-17 22:01:31,288 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(310): Store=ae3e5b9276c4b2ce0829f48ae5047078/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,288 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-17 22:01:31,288 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(310): Store=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure e769228ddcfcd2e056e78afd36bf36c1, server=jenkins-hbase9.apache.org,35117,1676671289663 in 184 msec 2023-02-17 22:01:31,288 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, ASSIGN in 351 msec 2023-02-17 22:01:31,289 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2 2023-02-17 22:01:31,289 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2 2023-02-17 22:01:31,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, ASSIGN in 351 msec 2023-02-17 22:01:31,289 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2 2023-02-17 22:01:31,289 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae3e5b9276c4b2ce0829f48ae5047078 columnFamilyName f2 2023-02-17 22:01:31,290 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2 2023-02-17 22:01:31,290 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 columnFamilyName f2 2023-02-17 22:01:31,290 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(310): Store=ae3e5b9276c4b2ce0829f48ae5047078/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,290 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(310): Store=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:31,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:31,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened ae3e5b9276c4b2ce0829f48ae5047078; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59931269, jitterRate=-0.10695450007915497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:31,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65270643, jitterRate=-0.027391627430915833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:31,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078., pid=21, masterSystemTime=1676671291250 2023-02-17 22:01:31,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:31,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:31,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:31,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ca3415a69d18dcbc6206c6bd541b8095, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 22:01:31,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ae3e5b9276c4b2ce0829f48ae5047078, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,297 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291297"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291297"}]},"ts":"1676671291297"} 2023-02-17 22:01:31,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,298 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,300 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1 2023-02-17 22:01:31,300 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1 2023-02-17 22:01:31,300 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca3415a69d18dcbc6206c6bd541b8095 columnFamilyName f1 2023-02-17 22:01:31,300 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(310): Store=ca3415a69d18dcbc6206c6bd541b8095/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,300 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,301 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2 2023-02-17 22:01:31,302 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2 2023-02-17 22:01:31,302 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca3415a69d18dcbc6206c6bd541b8095 columnFamilyName f2 2023-02-17 22:01:31,302 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(310): Store=ca3415a69d18dcbc6206c6bd541b8095/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:31,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079., pid=28, masterSystemTime=1676671291255 2023-02-17 22:01:31,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:31,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:31,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:31,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened ca3415a69d18dcbc6206c6bd541b8095; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71333448, jitterRate=0.06295120716094971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6afee56be47150e82bd109b76cca52fb, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:31,308 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,308 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291308"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291308"}]},"ts":"1676671291308"} 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-17 22:01:31,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure ae3e5b9276c4b2ce0829f48ae5047078, server=jenkins-hbase9.apache.org,45431,1676671289640 in 209 msec 2023-02-17 22:01:31,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095., pid=25, masterSystemTime=1676671291250 2023-02-17 22:01:31,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, ASSIGN in 372 msec 2023-02-17 22:01:31,310 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:31,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:31,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5a854a172d2e2ac6742c4c282ae7c0ec, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 22:01:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=ca3415a69d18dcbc6206c6bd541b8095, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291311"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291311"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291311"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291311"}]},"ts":"1676671291311"} 2023-02-17 22:01:31,311 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1 2023-02-17 22:01:31,311 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1 2023-02-17 22:01:31,312 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6afee56be47150e82bd109b76cca52fb columnFamilyName f1 2023-02-17 22:01:31,312 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,312 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(310): Store=6afee56be47150e82bd109b76cca52fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,312 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-17 22:01:31,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, server=jenkins-hbase9.apache.org,35117,1676671289663 in 205 msec 2023-02-17 22:01:31,314 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2 2023-02-17 22:01:31,314 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1 2023-02-17 22:01:31,314 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2 2023-02-17 22:01:31,314 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1 2023-02-17 22:01:31,314 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6afee56be47150e82bd109b76cca52fb columnFamilyName f2 2023-02-17 22:01:31,314 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a854a172d2e2ac6742c4c282ae7c0ec columnFamilyName f1 2023-02-17 22:01:31,320 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(310): Store=5a854a172d2e2ac6742c4c282ae7c0ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,320 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(310): Store=6afee56be47150e82bd109b76cca52fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,321 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-17 22:01:31,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure ca3415a69d18dcbc6206c6bd541b8095, server=jenkins-hbase9.apache.org,45431,1676671289640 in 212 msec 2023-02-17 22:01:31,321 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, ASSIGN in 376 msec 2023-02-17 22:01:31,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, ASSIGN in 384 msec 2023-02-17 22:01:31,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,325 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2 2023-02-17 22:01:31,325 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2 2023-02-17 22:01:31,326 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a854a172d2e2ac6742c4c282ae7c0ec columnFamilyName f2 2023-02-17 22:01:31,326 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(310): Store=5a854a172d2e2ac6742c4c282ae7c0ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:31,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:31,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 5a854a172d2e2ac6742c4c282ae7c0ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65343090, jitterRate=-0.02631208300590515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:31,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec., pid=22, masterSystemTime=1676671291250 2023-02-17 22:01:31,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 6afee56be47150e82bd109b76cca52fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62923859, jitterRate=-0.06236143410205841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:31,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb., pid=30, masterSystemTime=1676671291255 2023-02-17 22:01:31,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5a854a172d2e2ac6742c4c282ae7c0ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291340"}]},"ts":"1676671291340"} 2023-02-17 22:01:31,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:31,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:31,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:31,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c75ba8309d7fb83e9c48f0c33154468, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 22:01:31,342 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=6afee56be47150e82bd109b76cca52fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291342"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291342"}]},"ts":"1676671291342"} 2023-02-17 22:01:31,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:31,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-17 22:01:31,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure 5a854a172d2e2ac6742c4c282ae7c0ec, server=jenkins-hbase9.apache.org,45431,1676671289640 in 243 msec 2023-02-17 22:01:31,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-17 22:01:31,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 6afee56be47150e82bd109b76cca52fb, server=jenkins-hbase9.apache.org,35117,1676671289663 in 238 msec 2023-02-17 22:01:31,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:31,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, ASSIGN in 409 msec 2023-02-17 22:01:31,348 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, ASSIGN in 410 msec 2023-02-17 22:01:31,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:31,355 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,356 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1 2023-02-17 22:01:31,356 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1 2023-02-17 22:01:31,357 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c75ba8309d7fb83e9c48f0c33154468 columnFamilyName f1 2023-02-17 22:01:31,357 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(310): Store=2c75ba8309d7fb83e9c48f0c33154468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,357 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,359 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2 2023-02-17 22:01:31,359 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2 2023-02-17 22:01:31,359 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c75ba8309d7fb83e9c48f0c33154468 columnFamilyName f2 2023-02-17 22:01:31,359 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(310): Store=2c75ba8309d7fb83e9c48f0c33154468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:31,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:31,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:31,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:31,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 2c75ba8309d7fb83e9c48f0c33154468; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70522780, jitterRate=0.050871312618255615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:31,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:31,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468., pid=29, masterSystemTime=1676671291255 2023-02-17 22:01:31,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:31,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:31,368 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2c75ba8309d7fb83e9c48f0c33154468, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,368 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671291368"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671291368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671291368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671291368"}]},"ts":"1676671291368"} 2023-02-17 22:01:31,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-17 22:01:31,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure 2c75ba8309d7fb83e9c48f0c33154468, server=jenkins-hbase9.apache.org,35117,1676671289663 in 264 msec 2023-02-17 22:01:31,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-17 22:01:31,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, ASSIGN in 434 msec 2023-02-17 22:01:31,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:31,373 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671291373"}]},"ts":"1676671291373"} 2023-02-17 22:01:31,375 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-17 22:01:31,377 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:31,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 579 msec 2023-02-17 22:01:31,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:31,408 INFO [Listener at localhost/37939] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-17 22:01:31,408 DEBUG [Listener at localhost/37939] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-17 22:01:31,409 INFO [Listener at localhost/37939] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:31,412 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-17 22:01:31,412 INFO [Listener at localhost/37939] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:31,412 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-17 22:01:31,412 INFO [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:31,452 DEBUG [hconnection-0x6308ec50-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:31,463 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35117] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:31,463 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:31,469 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:31,536 INFO [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:31,536 INFO [Listener at localhost/37939] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:31,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 22:01:31,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671291537 (current time:1676671291537). 2023-02-17 22:01:31,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:31,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] zookeeper.ReadOnlyZKClient(139): Connect 0x30bb24cd to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:31,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@653b63ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:31,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:31,556 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:31,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30bb24cd to 127.0.0.1:58480 2023-02-17 22:01:31,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:31,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:31,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 22:01:31,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 22:01:31,561 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 22:01:31,561 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676671891561 2023-02-17 22:01:31,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 22:01:31,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,568 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 22:01:31,569 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:31,569 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:31,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 22:01:31,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 10 msec 2023-02-17 22:01:31,572 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 22:01:31,573 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676671891573 2023-02-17 22:01:31,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,596 INFO [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-17 22:01:31,596 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:31,597 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-17 22:01:31,597 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 22:01:31,599 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,599 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,600 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:31,601 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:31,601 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:31,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:31,601 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,601 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,603 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,603 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:31,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-17 22:01:31,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-17 22:01:31,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-17 22:01:31,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-17 22:01:31,605 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,605 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,605 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-17 22:01:31,605 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:31,613 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 22:01:31,613 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 22:01:31,613 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-17 22:01:31,613 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45431,1676671289640' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 22:01:31,613 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:31,614 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 22:01:31,614 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 22:01:31,614 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35117,1676671289663' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 22:01:31,615 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,615 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:31,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:31,615 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,615 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:31,616 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,616 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:31,616 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,616 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:31,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:31,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45431,1676671289640' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bb3ef6[Count = 1] remaining members to acquire global barrier 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:31,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:31,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35117,1676671289663' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 22:01:31,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bb3ef6[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:31,620 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 22:01:31,620 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,623 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:31,623 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:31,624 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,624 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,624 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:31,624 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:31,624 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. started... 2023-02-17 22:01:31,628 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6afee56be47150e82bd109b76cca52fb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:31,628 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 22:01:31,628 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. started... 2023-02-17 22:01:31,628 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 22:01:31,628 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:31,629 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. started... 2023-02-17 22:01:31,629 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. started... 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:31,632 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ca3415a69d18dcbc6206c6bd541b8095 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:31,632 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:31,628 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:31,632 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. started... 2023-02-17 22:01:31,632 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,632 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. started... 2023-02-17 22:01:31,633 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2c75ba8309d7fb83e9c48f0c33154468 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:31,633 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,633 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5a854a172d2e2ac6742c4c282ae7c0ec 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 22:01:31,634 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:31,634 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:31,669 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. completed. 2023-02-17 22:01:31,669 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:31,669 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f1/69ccb2fcaa7744469afe67ab42c325e0 2023-02-17 22:01:31,669 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 22:01:31,669 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:31,669 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:31,669 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. started... 2023-02-17 22:01:31,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 22:01:31,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:31,671 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:31,682 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f1/2683146a97614c4eaa06698569f9819c 2023-02-17 22:01:31,682 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f1/235d7d280ddb40eba52476e38ac41a30 2023-02-17 22:01:31,684 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1c6f8fceaaceac68b610dc7f69083f25 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 22:01:31,686 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f1/46e1545242084a8b8e7687fe04319f5a 2023-02-17 22:01:31,703 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f1/3da74ab5e64c48c28c31908758f21548 2023-02-17 22:01:31,727 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f1/1645d6542c3b47028a3e056ca4fb06d7 2023-02-17 22:01:31,728 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f2/7c6b2432afca489385e34eabc2c3c188 2023-02-17 22:01:31,739 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f1/69ccb2fcaa7744469afe67ab42c325e0 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/69ccb2fcaa7744469afe67ab42c325e0 2023-02-17 22:01:31,751 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f2/baa9ea1bfea344988193412faed8a3a2 2023-02-17 22:01:31,752 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/69ccb2fcaa7744469afe67ab42c325e0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,754 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f2/7c6b2432afca489385e34eabc2c3c188 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/7c6b2432afca489385e34eabc2c3c188 2023-02-17 22:01:31,758 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f1/3da74ab5e64c48c28c31908758f21548 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/3da74ab5e64c48c28c31908758f21548 2023-02-17 22:01:31,759 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f2/8de6d08b361a473894391f92d5331285 2023-02-17 22:01:31,760 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f2/e1bfeac389d74eb68e63161789e21cbd 2023-02-17 22:01:31,760 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f2/bbc6c16b7d2b4f239251cbb562b54448 2023-02-17 22:01:31,765 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/7c6b2432afca489385e34eabc2c3c188, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,766 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6afee56be47150e82bd109b76cca52fb in 138ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,766 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-17 22:01:31,766 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/3da74ab5e64c48c28c31908758f21548, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,768 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:31,768 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,770 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,770 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f2/baa9ea1bfea344988193412faed8a3a2 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/baa9ea1bfea344988193412faed8a3a2 2023-02-17 22:01:31,770 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/69ccb2fcaa7744469afe67ab42c325e0] hfiles 2023-02-17 22:01:31,770 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/69ccb2fcaa7744469afe67ab42c325e0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,770 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/7c6b2432afca489385e34eabc2c3c188] hfiles 2023-02-17 22:01:31,770 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/7c6b2432afca489385e34eabc2c3c188 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,774 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f1/2683146a97614c4eaa06698569f9819c as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/2683146a97614c4eaa06698569f9819c 2023-02-17 22:01:31,775 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f1/46e1545242084a8b8e7687fe04319f5a as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/46e1545242084a8b8e7687fe04319f5a 2023-02-17 22:01:31,781 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/baa9ea1bfea344988193412faed8a3a2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,783 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/2683146a97614c4eaa06698569f9819c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,783 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ca3415a69d18dcbc6206c6bd541b8095 in 151ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,784 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/46e1545242084a8b8e7687fe04319f5a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/3da74ab5e64c48c28c31908758f21548] hfiles 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/3da74ab5e64c48c28c31908758f21548 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/baa9ea1bfea344988193412faed8a3a2] hfiles 2023-02-17 22:01:31,786 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/baa9ea1bfea344988193412faed8a3a2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,791 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f2/e1bfeac389d74eb68e63161789e21cbd as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/e1bfeac389d74eb68e63161789e21cbd 2023-02-17 22:01:31,792 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f1/235d7d280ddb40eba52476e38ac41a30 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/235d7d280ddb40eba52476e38ac41a30 2023-02-17 22:01:31,792 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f2/bbc6c16b7d2b4f239251cbb562b54448 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/bbc6c16b7d2b4f239251cbb562b54448 2023-02-17 22:01:31,800 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/235d7d280ddb40eba52476e38ac41a30, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,800 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/bbc6c16b7d2b4f239251cbb562b54448, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:31,801 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5a854a172d2e2ac6742c4c282ae7c0ec in 168ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f2/8de6d08b361a473894391f92d5331285 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/8de6d08b361a473894391f92d5331285 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/46e1545242084a8b8e7687fe04319f5a] hfiles 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/46e1545242084a8b8e7687fe04319f5a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/bbc6c16b7d2b4f239251cbb562b54448] hfiles 2023-02-17 22:01:31,801 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/bbc6c16b7d2b4f239251cbb562b54448 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,811 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f2/857069916d93413cb5ac9427724a8609 2023-02-17 22:01:31,816 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/e1bfeac389d74eb68e63161789e21cbd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,816 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/8de6d08b361a473894391f92d5331285, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,817 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 in 188ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,817 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2c75ba8309d7fb83e9c48f0c33154468 in 184ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,817 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/2683146a97614c4eaa06698569f9819c] hfiles 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/235d7d280ddb40eba52476e38ac41a30] hfiles 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/2683146a97614c4eaa06698569f9819c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/235d7d280ddb40eba52476e38ac41a30 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/e1bfeac389d74eb68e63161789e21cbd] hfiles 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/8de6d08b361a473894391f92d5331285] hfiles 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/8de6d08b361a473894391f92d5331285 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,818 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/e1bfeac389d74eb68e63161789e21cbd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,819 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f1/1645d6542c3b47028a3e056ca4fb06d7 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/1645d6542c3b47028a3e056ca4fb06d7 2023-02-17 22:01:31,823 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/1645d6542c3b47028a3e056ca4fb06d7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:31,824 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f2/857069916d93413cb5ac9427724a8609 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/857069916d93413cb5ac9427724a8609 2023-02-17 22:01:31,831 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. completed. 2023-02-17 22:01:31,831 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:31,831 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:31,831 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 22:01:31,831 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. started... 2023-02-17 22:01:31,833 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:31,833 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,833 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,833 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:31,833 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 22:01:31,835 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/857069916d93413cb5ac9427724a8609, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 22:01:31,836 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1c6f8fceaaceac68b610dc7f69083f25 in 153ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/1645d6542c3b47028a3e056ca4fb06d7] hfiles 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/1645d6542c3b47028a3e056ca4fb06d7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/857069916d93413cb5ac9427724a8609] hfiles 2023-02-17 22:01:31,836 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/857069916d93413cb5ac9427724a8609 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,846 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. completed. 2023-02-17 22:01:31,846 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. completed. 2023-02-17 22:01:31,846 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:31,846 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:31,846 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 22:01:31,846 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:31,846 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 22:01:31,846 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. started... 2023-02-17 22:01:31,848 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ae3e5b9276c4b2ce0829f48ae5047078 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:31,850 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. completed. 2023-02-17 22:01:31,850 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:31,850 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:31,850 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 22:01:31,850 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. started... 2023-02-17 22:01:31,852 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 0c80d785b8b0fee20fae3c6c1bb123ae 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 22:01:31,852 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. completed. 2023-02-17 22:01:31,852 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:31,852 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 22:01:31,858 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. completed. 2023-02-17 22:01:31,858 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:31,858 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 22:01:31,862 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f1/72272420b45e4f628ecbf59e3b43be3f 2023-02-17 22:01:31,863 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f1/7dc1956137da4accb36fea4127833347 2023-02-17 22:01:31,871 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:31,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 22:01:31,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:31,873 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 22:01:31,878 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f2/bba2f5658b0e4491a59ce901d124d474 2023-02-17 22:01:31,880 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f2/d745ff12f1694cba960ef4f05253a7b2 2023-02-17 22:01:31,883 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f1/72272420b45e4f628ecbf59e3b43be3f as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/72272420b45e4f628ecbf59e3b43be3f 2023-02-17 22:01:31,885 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f1/7dc1956137da4accb36fea4127833347 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/7dc1956137da4accb36fea4127833347 2023-02-17 22:01:31,888 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/72272420b45e4f628ecbf59e3b43be3f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,889 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f2/bba2f5658b0e4491a59ce901d124d474 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/bba2f5658b0e4491a59ce901d124d474 2023-02-17 22:01:31,890 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/7dc1956137da4accb36fea4127833347, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,891 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f2/d745ff12f1694cba960ef4f05253a7b2 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/d745ff12f1694cba960ef4f05253a7b2 2023-02-17 22:01:31,896 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/bba2f5658b0e4491a59ce901d124d474, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,899 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0c80d785b8b0fee20fae3c6c1bb123ae in 47ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/72272420b45e4f628ecbf59e3b43be3f] hfiles 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/72272420b45e4f628ecbf59e3b43be3f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/bba2f5658b0e4491a59ce901d124d474] hfiles 2023-02-17 22:01:31,899 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/bba2f5658b0e4491a59ce901d124d474 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,904 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/d745ff12f1694cba960ef4f05253a7b2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 22:01:31,905 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ae3e5b9276c4b2ce0829f48ae5047078 in 57ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/7dc1956137da4accb36fea4127833347] hfiles 2023-02-17 22:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/7dc1956137da4accb36fea4127833347 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/d745ff12f1694cba960ef4f05253a7b2] hfiles 2023-02-17 22:01:31,906 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/d745ff12f1694cba960ef4f05253a7b2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,915 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. completed. 2023-02-17 22:01:31,915 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:31,915 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 22:01:31,915 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 22:01:31,915 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,915 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 22:01:31,915 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,35117,1676671289663' in zk 2023-02-17 22:01:31,917 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 22:01:31,917 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,917 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:31,918 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 22:01:31,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:31,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:31,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,35117,1676671289663': 2023-02-17 22:01:31,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35117,1676671289663' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 22:01:31,932 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. completed. 2023-02-17 22:01:31,932 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:31,932 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 22:01:32,173 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:32,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 22:01:32,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:32,175 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 22:01:32,256 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. completed. 2023-02-17 22:01:32,256 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:32,256 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 22:01:32,256 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 22:01:32,256 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,256 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 22:01:32,256 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,45431,1676671289640' in zk 2023-02-17 22:01:32,259 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,259 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 22:01:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:32,259 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:32,259 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 22:01:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,45431,1676671289640': 2023-02-17 22:01:32,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45431,1676671289640' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:32,263 INFO [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-17 22:01:32,263 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:32,263 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:32,263 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,263 INFO [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:32,265 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:32,265 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:32,265 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,266 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:32,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,266 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,268 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,268 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,273 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:32,273 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,273 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:32,274 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:32,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,274 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:32,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:32,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:32,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-17 22:01:32,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,338 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676671291567Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676671292274 (+707 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676671292274Writing data manifest for testWithMockedMapReduceMultiRegion at 1676671292289 (+15 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676671292298 (+9 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676671292337 (+39 ms) 2023-02-17 22:01:32,340 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 22:01:32,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 772 msec 2023-02-17 22:01:32,675 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:32,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 22:01:32,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:32,677 INFO [Listener at localhost/37939] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:32,682 INFO [Listener at localhost/37939] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:32,688 INFO [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:32,719 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45431] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:32,719 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35117] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:32,776 INFO [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:32,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:32,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,784 INFO [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-17 22:01:32,784 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:32,785 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-17 22:01:32,785 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 22:01:32,785 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,786 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,787 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:32,787 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:32,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:32,787 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:32,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:32,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:32,787 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,787 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,788 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,788 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,789 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-17 22:01:32,789 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-17 22:01:32,789 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:32,789 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:32,789 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 22:01:32,790 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 22:01:32,790 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:32,790 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. started... 2023-02-17 22:01:32,790 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:32,790 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. started... 2023-02-17 22:01:32,790 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6afee56be47150e82bd109b76cca52fb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:32,790 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:32,790 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. started... 2023-02-17 22:01:32,795 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 22:01:32,795 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:32,795 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 22:01:32,795 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. started... 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:32,795 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:32,795 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2c75ba8309d7fb83e9c48f0c33154468 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. started... 2023-02-17 22:01:32,795 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:32,795 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 22:01:32,796 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. started... 2023-02-17 22:01:32,796 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1c6f8fceaaceac68b610dc7f69083f25 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 22:01:32,796 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. started... 2023-02-17 22:01:32,796 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5a854a172d2e2ac6742c4c282ae7c0ec 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 22:01:32,796 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ca3415a69d18dcbc6206c6bd541b8095 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:32,814 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f1/7acc5f6a8f10440c93ff89b0742ca9a3 2023-02-17 22:01:32,815 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f1/7d7cbc85954a43fd86a538cfded381dc 2023-02-17 22:01:32,817 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f1/bee38db06f9d412595fee5b99131238b 2023-02-17 22:01:32,821 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f1/d2f7b712a13240b6bfe23a8604028dce 2023-02-17 22:01:32,822 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f1/363ee235ba524e0b9236f3c864b9e192 2023-02-17 22:01:32,823 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f1/6b2b2aed3f2041f7a7266733b864f62b 2023-02-17 22:01:32,848 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f2/377210599ce5470eab6dd5886b31d5d3 2023-02-17 22:01:32,853 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f1/7acc5f6a8f10440c93ff89b0742ca9a3 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/7acc5f6a8f10440c93ff89b0742ca9a3 2023-02-17 22:01:32,858 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/7acc5f6a8f10440c93ff89b0742ca9a3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,859 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/.tmp/f2/377210599ce5470eab6dd5886b31d5d3 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/377210599ce5470eab6dd5886b31d5d3 2023-02-17 22:01:32,863 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f2/b85fb50afd4f419ba7593b6967de7eb6 2023-02-17 22:01:32,872 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f2/f307fcb805b54e6fb4011aa9fd0d90e6 2023-02-17 22:01:32,876 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f2/5ae266d3d2404eb0863be633096b8528 2023-02-17 22:01:32,876 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/377210599ce5470eab6dd5886b31d5d3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,877 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2c75ba8309d7fb83e9c48f0c33154468 in 82ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,877 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:32,877 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:32,878 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f1/bee38db06f9d412595fee5b99131238b as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/bee38db06f9d412595fee5b99131238b 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f1/7d7cbc85954a43fd86a538cfded381dc as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/7d7cbc85954a43fd86a538cfded381dc 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:32,879 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. started... 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:32,879 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. started... 2023-02-17 22:01:32,879 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0c80d785b8b0fee20fae3c6c1bb123ae 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:32,879 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f2/357cebbfed344f31a0754b95eacef914 2023-02-17 22:01:32,879 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 22:01:32,883 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f1/d2f7b712a13240b6bfe23a8604028dce as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/d2f7b712a13240b6bfe23a8604028dce 2023-02-17 22:01:32,884 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/7d7cbc85954a43fd86a538cfded381dc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,884 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/.tmp/f2/b85fb50afd4f419ba7593b6967de7eb6 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/b85fb50afd4f419ba7593b6967de7eb6 2023-02-17 22:01:32,885 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/bee38db06f9d412595fee5b99131238b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:32,890 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/.tmp/f2/f307fcb805b54e6fb4011aa9fd0d90e6 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/f307fcb805b54e6fb4011aa9fd0d90e6 2023-02-17 22:01:32,895 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f1/363ee235ba524e0b9236f3c864b9e192 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/363ee235ba524e0b9236f3c864b9e192 2023-02-17 22:01:32,895 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/b85fb50afd4f419ba7593b6967de7eb6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,895 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f2/fbf1268f9bd142508b1528602b1ba51f 2023-02-17 22:01:32,896 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6afee56be47150e82bd109b76cca52fb in 106ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,896 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:32,896 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:32,896 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 22:01:32,900 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/d2f7b712a13240b6bfe23a8604028dce, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:32,900 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/f307fcb805b54e6fb4011aa9fd0d90e6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:32,900 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/363ee235ba524e0b9236f3c864b9e192, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,901 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/.tmp/f2/5ae266d3d2404eb0863be633096b8528 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/5ae266d3d2404eb0863be633096b8528 2023-02-17 22:01:32,901 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5a854a172d2e2ac6742c4c282ae7c0ec in 105ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,901 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/.tmp/f2/357cebbfed344f31a0754b95eacef914 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/357cebbfed344f31a0754b95eacef914 2023-02-17 22:01:32,901 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:32,901 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f1/6b2b2aed3f2041f7a7266733b864f62b as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/6b2b2aed3f2041f7a7266733b864f62b 2023-02-17 22:01:32,901 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:32,902 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:32,902 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 22:01:32,902 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. started... 2023-02-17 22:01:32,902 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ae3e5b9276c4b2ce0829f48ae5047078 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 22:01:32,906 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f1/e8eeae10cba04ec6af5763017fc7b59c 2023-02-17 22:01:32,911 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/5ae266d3d2404eb0863be633096b8528, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 22:01:32,911 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/357cebbfed344f31a0754b95eacef914, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,911 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/6b2b2aed3f2041f7a7266733b864f62b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,912 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1c6f8fceaaceac68b610dc7f69083f25 in 116ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,912 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/.tmp/f2/fbf1268f9bd142508b1528602b1ba51f as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/fbf1268f9bd142508b1528602b1ba51f 2023-02-17 22:01:32,912 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:32,912 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:32,912 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ca3415a69d18dcbc6206c6bd541b8095 in 116ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,912 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:32,912 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:32,912 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 22:01:32,912 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 22:01:32,917 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/fbf1268f9bd142508b1528602b1ba51f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,918 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 in 123ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,918 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:32,918 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:32,918 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 22:01:32,923 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f1/94cfc298d7f34188a17c6666ac56d91f 2023-02-17 22:01:32,926 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f2/2f93a779212d4c248e5bdac85ff86f02 2023-02-17 22:01:32,930 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f1/e8eeae10cba04ec6af5763017fc7b59c as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/e8eeae10cba04ec6af5763017fc7b59c 2023-02-17 22:01:32,936 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/e8eeae10cba04ec6af5763017fc7b59c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,937 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/.tmp/f2/2f93a779212d4c248e5bdac85ff86f02 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/2f93a779212d4c248e5bdac85ff86f02 2023-02-17 22:01:32,941 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/2f93a779212d4c248e5bdac85ff86f02, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,941 INFO [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0c80d785b8b0fee20fae3c6c1bb123ae in 62ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,942 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:32,942 DEBUG [rs(jenkins-hbase9.apache.org,35117,1676671289663)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:32,942 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 22:01:32,942 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 22:01:32,942 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,942 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 22:01:32,942 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35117,1676671289663' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 22:01:32,944 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,944 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:32,944 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,944 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35117,1676671289663' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 22:01:32,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84bab9[Count = 1] remaining members to acquire global barrier 2023-02-17 22:01:32,949 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f2/32fac1fef0204ea2b073c128af3f4074 2023-02-17 22:01:32,953 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f1/94cfc298d7f34188a17c6666ac56d91f as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/94cfc298d7f34188a17c6666ac56d91f 2023-02-17 22:01:32,959 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/94cfc298d7f34188a17c6666ac56d91f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,960 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/.tmp/f2/32fac1fef0204ea2b073c128af3f4074 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/32fac1fef0204ea2b073c128af3f4074 2023-02-17 22:01:32,964 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/32fac1fef0204ea2b073c128af3f4074, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 22:01:32,964 INFO [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ae3e5b9276c4b2ce0829f48ae5047078 in 62ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:32,964 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:32,964 DEBUG [rs(jenkins-hbase9.apache.org,45431,1676671289640)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:32,964 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 22:01:32,965 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 22:01:32,965 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,965 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 22:01:32,965 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45431,1676671289640' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 22:01:32,966 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,966 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:32,967 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,967 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45431,1676671289640' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 22:01:32,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84bab9[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:32,968 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 22:01:32,968 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,969 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,969 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,970 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,970 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:32,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,970 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 22:01:32,970 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 22:01:32,970 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 22:01:32,970 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,35117,1676671289663' in zk 2023-02-17 22:01:32,970 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase9.apache.org,45431,1676671289640' in zk 2023-02-17 22:01:32,970 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,970 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:32,972 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,972 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 22:01:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:32,972 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:32,972 DEBUG [member: 'jenkins-hbase9.apache.org,35117,1676671289663' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 22:01:32,973 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,973 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 22:01:32,973 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:32,973 DEBUG [member: 'jenkins-hbase9.apache.org,45431,1676671289640' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 22:01:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,35117,1676671289663': 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35117,1676671289663' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase9.apache.org,45431,1676671289640': 2023-02-17 22:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45431,1676671289640' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:32,977 INFO [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-17 22:01:32,977 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:32,977 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:32,978 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,978 INFO [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:32,979 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:32,979 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,979 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:32,979 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:32,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,980 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:32,981 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,982 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,984 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:32,984 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:32,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:32,984 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:32,984 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-17 22:01:32,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:32,984 DEBUG [(jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:32,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:32,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:32,984 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:32,984 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:32,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:32,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:32,985 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,085 DEBUG [Listener at localhost/37939] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:33,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:33,091 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676671291537 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:33,092 DEBUG [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,092 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:33,092 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:33,092 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:33,092 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:33,092 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(239): region to add: ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=6afee56be47150e82bd109b76cca52fb as 6afee56be47150e82bd109b76cca52fb in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 as 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=2c75ba8309d7fb83e9c48f0c33154468 as 2c75ba8309d7fb83e9c48f0c33154468 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=0418ab664c892c2595c8d9aec2d31305 as 0418ab664c892c2595c8d9aec2d31305 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=ca3415a69d18dcbc6206c6bd541b8095 as ca3415a69d18dcbc6206c6bd541b8095 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=5a854a172d2e2ac6742c4c282ae7c0ec as 5a854a172d2e2ac6742c4c282ae7c0ec in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=e769228ddcfcd2e056e78afd36bf36c1 as e769228ddcfcd2e056e78afd36bf36c1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,093 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=0c80d785b8b0fee20fae3c6c1bb123ae as 0c80d785b8b0fee20fae3c6c1bb123ae in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,094 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=1c6f8fceaaceac68b610dc7f69083f25 as 1c6f8fceaaceac68b610dc7f69083f25 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,094 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(585): clone region=ae3e5b9276c4b2ce0829f48ae5047078 as ae3e5b9276c4b2ce0829f48ae5047078 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,095 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0c80d785b8b0fee20fae3c6c1bb123ae, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,095 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e769228ddcfcd2e056e78afd36bf36c1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,095 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6afee56be47150e82bd109b76cca52fb, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,095 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ca3415a69d18dcbc6206c6bd541b8095, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,096 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 0418ab664c892c2595c8d9aec2d31305, NAME => 'testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,096 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,096 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 5a854a172d2e2ac6742c4c282ae7c0ec, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,096 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2c75ba8309d7fb83e9c48f0c33154468, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,119 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,119 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,119 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2683146a97614c4eaa06698569f9819c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,119 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 72272420b45e4f628ecbf59e3b43be3f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,129 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,129 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,129 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46e1545242084a8b8e7687fe04319f5a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,129 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 69ccb2fcaa7744469afe67ab42c325e0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,135 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e1bfeac389d74eb68e63161789e21cbd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,141 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bba2f5658b0e4491a59ce901d124d474 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,143 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7c6b2432afca489385e34eabc2c3c188 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,143 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,143 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3da74ab5e64c48c28c31908758f21548 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,155 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, disabling compactions & flushes 2023-02-17 22:01:33,155 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink baa9ea1bfea344988193412faed8a3a2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,155 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:33,155 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:33,155 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. after waiting 0 ms 2023-02-17 22:01:33,155 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:33,155 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:33,155 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:33,155 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,156 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbc6c16b7d2b4f239251cbb562b54448 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0c80d785b8b0fee20fae3c6c1bb123ae, disabling compactions & flushes 2023-02-17 22:01:33,156 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,156 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1c6f8fceaaceac68b610dc7f69083f25, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,156 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 235d7d280ddb40eba52476e38ac41a30 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. after waiting 0 ms 2023-02-17 22:01:33,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,156 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:33,157 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ae3e5b9276c4b2ce0829f48ae5047078, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,158 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,158 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e769228ddcfcd2e056e78afd36bf36c1, disabling compactions & flushes 2023-02-17 22:01:33,158 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:33,158 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:33,158 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. after waiting 0 ms 2023-02-17 22:01:33,158 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:33,158 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:33,158 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:33,159 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,159 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 0418ab664c892c2595c8d9aec2d31305, disabling compactions & flushes 2023-02-17 22:01:33,159 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6afee56be47150e82bd109b76cca52fb, disabling compactions & flushes 2023-02-17 22:01:33,159 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ca3415a69d18dcbc6206c6bd541b8095, disabling compactions & flushes 2023-02-17 22:01:33,160 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 5a854a172d2e2ac6742c4c282ae7c0ec, disabling compactions & flushes 2023-02-17 22:01:33,160 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:33,159 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. after waiting 0 ms 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. after waiting 0 ms 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:33,160 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:33,160 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. after waiting 0 ms 2023-02-17 22:01:33,160 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:33,161 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:33,160 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,161 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. after waiting 0 ms 2023-02-17 22:01:33,161 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:33,161 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,161 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:33,161 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:33,161 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:33,161 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8de6d08b361a473894391f92d5331285 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,165 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 2c75ba8309d7fb83e9c48f0c33154468, disabling compactions & flushes 2023-02-17 22:01:33,165 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,165 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,165 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. after waiting 0 ms 2023-02-17 22:01:33,165 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,165 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,165 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:33,166 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,166 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7dc1956137da4accb36fea4127833347 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,166 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,166 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1645d6542c3b47028a3e056ca4fb06d7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,168 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d745ff12f1694cba960ef4f05253a7b2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,168 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 857069916d93413cb5ac9427724a8609 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:33,175 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ae3e5b9276c4b2ce0829f48ae5047078, disabling compactions & flushes 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 1c6f8fceaaceac68b610dc7f69083f25, disabling compactions & flushes 2023-02-17 22:01:33,176 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:33,176 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. after waiting 0 ms 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. after waiting 0 ms 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,176 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:33,176 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:33,176 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:33,176 INFO [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676671291537 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:33,177 DEBUG [Listener at localhost/37939] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,177 DEBUG [Listener at localhost/37939] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126 2023-02-17 22:01:33,177 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:33,178 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:33,178 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-17 22:01:33,179 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------0418ab664c892c2595c8d9aec2d31305/ 2023-02-17 22:01:33,179 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,179 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------0c80d785b8b0fee20fae3c6c1bb123ae/ 2023-02-17 22:01:33,180 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,180 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,180 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0c80d785b8b0fee20fae3c6c1bb123ae-72272420b45e4f628ecbf59e3b43be3f 2023-02-17 22:01:33,180 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,180 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0c80d785b8b0fee20fae3c6c1bb123ae-bba2f5658b0e4491a59ce901d124d474 2023-02-17 22:01:33,180 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------1c6f8fceaaceac68b610dc7f69083f25/ 2023-02-17 22:01:33,181 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,181 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,181 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1c6f8fceaaceac68b610dc7f69083f25-1645d6542c3b47028a3e056ca4fb06d7 2023-02-17 22:01:33,181 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,181 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1c6f8fceaaceac68b610dc7f69083f25-857069916d93413cb5ac9427724a8609 2023-02-17 22:01:33,182 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------2c75ba8309d7fb83e9c48f0c33154468/ 2023-02-17 22:01:33,182 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,182 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,182 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2c75ba8309d7fb83e9c48f0c33154468-235d7d280ddb40eba52476e38ac41a30 2023-02-17 22:01:33,182 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,183 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2c75ba8309d7fb83e9c48f0c33154468-8de6d08b361a473894391f92d5331285 2023-02-17 22:01:33,183 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------5a854a172d2e2ac6742c4c282ae7c0ec/ 2023-02-17 22:01:33,183 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,183 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,183 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5a854a172d2e2ac6742c4c282ae7c0ec-46e1545242084a8b8e7687fe04319f5a 2023-02-17 22:01:33,183 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,184 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5a854a172d2e2ac6742c4c282ae7c0ec-bbc6c16b7d2b4f239251cbb562b54448 2023-02-17 22:01:33,184 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------6afee56be47150e82bd109b76cca52fb/ 2023-02-17 22:01:33,184 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,184 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,185 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6afee56be47150e82bd109b76cca52fb-69ccb2fcaa7744469afe67ab42c325e0 2023-02-17 22:01:33,185 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,185 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6afee56be47150e82bd109b76cca52fb-7c6b2432afca489385e34eabc2c3c188 2023-02-17 22:01:33,185 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/ 2023-02-17 22:01:33,185 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,185 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,186 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-2683146a97614c4eaa06698569f9819c 2023-02-17 22:01:33,186 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,186 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-e1bfeac389d74eb68e63161789e21cbd 2023-02-17 22:01:33,186 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------ae3e5b9276c4b2ce0829f48ae5047078/ 2023-02-17 22:01:33,187 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,187 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,187 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ae3e5b9276c4b2ce0829f48ae5047078-7dc1956137da4accb36fea4127833347 2023-02-17 22:01:33,187 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,187 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ae3e5b9276c4b2ce0829f48ae5047078-d745ff12f1694cba960ef4f05253a7b2 2023-02-17 22:01:33,187 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------ca3415a69d18dcbc6206c6bd541b8095/ 2023-02-17 22:01:33,188 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,188 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:33,188 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ca3415a69d18dcbc6206c6bd541b8095-3da74ab5e64c48c28c31908758f21548 2023-02-17 22:01:33,188 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:33,188 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ca3415a69d18dcbc6206c6bd541b8095-baa9ea1bfea344988193412faed8a3a2 2023-02-17 22:01:33,188 DEBUG [Listener at localhost/37939] util.CommonFSUtils(699): |----------e769228ddcfcd2e056e78afd36bf36c1/ 2023-02-17 22:01:33,189 DEBUG [Listener at localhost/37939] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:33,192 INFO [Listener at localhost/37939] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 22:01:33,895 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,895 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:33,897 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:33,899 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:33,901 DEBUG [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f1 2023-02-17 22:01:33,901 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0418ab664c892c2595c8d9aec2d31305 columnFamilyName f1 2023-02-17 22:01:33,902 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(310): Store=0418ab664c892c2595c8d9aec2d31305/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,902 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:33,903 DEBUG [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f2 2023-02-17 22:01:33,903 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0418ab664c892c2595c8d9aec2d31305 columnFamilyName f2 2023-02-17 22:01:33,904 INFO [StoreOpener-0418ab664c892c2595c8d9aec2d31305-1] regionserver.HStore(310): Store=0418ab664c892c2595c8d9aec2d31305/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,904 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:33,904 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 0418ab664c892c2595c8d9aec2d31305; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59679081, jitterRate=-0.11071239411830902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:33,904 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:33,905 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 0418ab664c892c2595c8d9aec2d31305, disabling compactions & flushes 2023-02-17 22:01:33,905 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,905 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,905 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. after waiting 0 ms 2023-02-17 22:01:33,905 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,905 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:33,905 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:33,906 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,906 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:33,908 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:33,910 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:33,910 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1 2023-02-17 22:01:33,911 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c80d785b8b0fee20fae3c6c1bb123ae columnFamilyName f1 2023-02-17 22:01:33,916 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/testWithMockedMapReduceMultiRegion=0c80d785b8b0fee20fae3c6c1bb123ae-72272420b45e4f628ecbf59e3b43be3f 2023-02-17 22:01:33,916 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(310): Store=0c80d785b8b0fee20fae3c6c1bb123ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,916 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:33,917 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2 2023-02-17 22:01:33,917 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c80d785b8b0fee20fae3c6c1bb123ae columnFamilyName f2 2023-02-17 22:01:33,921 DEBUG [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/testWithMockedMapReduceMultiRegion=0c80d785b8b0fee20fae3c6c1bb123ae-bba2f5658b0e4491a59ce901d124d474 2023-02-17 22:01:33,921 INFO [StoreOpener-0c80d785b8b0fee20fae3c6c1bb123ae-1] regionserver.HStore(310): Store=0c80d785b8b0fee20fae3c6c1bb123ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,921 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:33,921 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 0c80d785b8b0fee20fae3c6c1bb123ae; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60173011, jitterRate=-0.10335226356983185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:33,921 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:33,931 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 0c80d785b8b0fee20fae3c6c1bb123ae, disabling compactions & flushes 2023-02-17 22:01:33,931 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,931 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,931 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. after waiting 0 ms 2023-02-17 22:01:33,931 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,936 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:33,936 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:33,937 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,937 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:33,938 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:33,949 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:33,949 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1 2023-02-17 22:01:33,950 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6f8fceaaceac68b610dc7f69083f25 columnFamilyName f1 2023-02-17 22:01:33,955 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/testWithMockedMapReduceMultiRegion=1c6f8fceaaceac68b610dc7f69083f25-1645d6542c3b47028a3e056ca4fb06d7 2023-02-17 22:01:33,955 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(310): Store=1c6f8fceaaceac68b610dc7f69083f25/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,955 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:33,956 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2 2023-02-17 22:01:33,956 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c6f8fceaaceac68b610dc7f69083f25 columnFamilyName f2 2023-02-17 22:01:33,962 DEBUG [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/testWithMockedMapReduceMultiRegion=1c6f8fceaaceac68b610dc7f69083f25-857069916d93413cb5ac9427724a8609 2023-02-17 22:01:33,962 INFO [StoreOpener-1c6f8fceaaceac68b610dc7f69083f25-1] regionserver.HStore(310): Store=1c6f8fceaaceac68b610dc7f69083f25/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,962 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:33,962 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 1c6f8fceaaceac68b610dc7f69083f25; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65258534, jitterRate=-0.027572065591812134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:33,962 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:33,972 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 1c6f8fceaaceac68b610dc7f69083f25, disabling compactions & flushes 2023-02-17 22:01:33,972 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,972 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,972 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. after waiting 0 ms 2023-02-17 22:01:33,972 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,973 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:33,973 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:33,973 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,973 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:33,975 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:33,977 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:33,978 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1 2023-02-17 22:01:33,978 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c75ba8309d7fb83e9c48f0c33154468 columnFamilyName f1 2023-02-17 22:01:33,982 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/testWithMockedMapReduceMultiRegion=2c75ba8309d7fb83e9c48f0c33154468-235d7d280ddb40eba52476e38ac41a30 2023-02-17 22:01:33,982 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(310): Store=2c75ba8309d7fb83e9c48f0c33154468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,982 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:33,983 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2 2023-02-17 22:01:33,983 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c75ba8309d7fb83e9c48f0c33154468 columnFamilyName f2 2023-02-17 22:01:33,986 DEBUG [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/testWithMockedMapReduceMultiRegion=2c75ba8309d7fb83e9c48f0c33154468-8de6d08b361a473894391f92d5331285 2023-02-17 22:01:33,987 INFO [StoreOpener-2c75ba8309d7fb83e9c48f0c33154468-1] regionserver.HStore(310): Store=2c75ba8309d7fb83e9c48f0c33154468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:33,987 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:33,987 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 2c75ba8309d7fb83e9c48f0c33154468; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60384866, jitterRate=-0.10019537806510925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:33,987 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:33,996 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 2c75ba8309d7fb83e9c48f0c33154468, disabling compactions & flushes 2023-02-17 22:01:33,996 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,996 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,996 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. after waiting 0 ms 2023-02-17 22:01:33,996 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,997 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:33,997 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:33,998 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:33,998 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:33,999 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:34,000 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:34,001 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1 2023-02-17 22:01:34,001 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6afee56be47150e82bd109b76cca52fb columnFamilyName f1 2023-02-17 22:01:34,005 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/testWithMockedMapReduceMultiRegion=6afee56be47150e82bd109b76cca52fb-69ccb2fcaa7744469afe67ab42c325e0 2023-02-17 22:01:34,005 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(310): Store=6afee56be47150e82bd109b76cca52fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,005 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:34,006 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2 2023-02-17 22:01:34,006 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6afee56be47150e82bd109b76cca52fb columnFamilyName f2 2023-02-17 22:01:34,009 DEBUG [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/testWithMockedMapReduceMultiRegion=6afee56be47150e82bd109b76cca52fb-7c6b2432afca489385e34eabc2c3c188 2023-02-17 22:01:34,009 INFO [StoreOpener-6afee56be47150e82bd109b76cca52fb-1] regionserver.HStore(310): Store=6afee56be47150e82bd109b76cca52fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,010 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:34,010 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 6afee56be47150e82bd109b76cca52fb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61202768, jitterRate=-0.08800768852233887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:34,010 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:34,018 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 6afee56be47150e82bd109b76cca52fb, disabling compactions & flushes 2023-02-17 22:01:34,018 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,018 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,018 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. after waiting 0 ms 2023-02-17 22:01:34,018 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,019 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,019 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:34,020 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:34,020 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:34,021 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:34,022 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:34,023 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1 2023-02-17 22:01:34,023 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 columnFamilyName f1 2023-02-17 22:01:34,027 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/testWithMockedMapReduceMultiRegion=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-2683146a97614c4eaa06698569f9819c 2023-02-17 22:01:34,027 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(310): Store=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,028 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:34,028 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2 2023-02-17 22:01:34,028 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 columnFamilyName f2 2023-02-17 22:01:34,032 DEBUG [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/testWithMockedMapReduceMultiRegion=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-e1bfeac389d74eb68e63161789e21cbd 2023-02-17 22:01:34,032 INFO [StoreOpener-7f0c9b7d6c34b3b9bf3b6a5d1e2f4079-1] regionserver.HStore(310): Store=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,032 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:34,032 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66069069, jitterRate=-0.015494152903556824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:34,033 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:34,044 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, disabling compactions & flushes 2023-02-17 22:01:34,045 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,045 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,045 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. after waiting 0 ms 2023-02-17 22:01:34,045 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,046 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,046 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:34,046 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:34,046 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:34,048 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:34,050 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:34,051 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1 2023-02-17 22:01:34,051 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae3e5b9276c4b2ce0829f48ae5047078 columnFamilyName f1 2023-02-17 22:01:34,059 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/testWithMockedMapReduceMultiRegion=ae3e5b9276c4b2ce0829f48ae5047078-7dc1956137da4accb36fea4127833347 2023-02-17 22:01:34,060 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(310): Store=ae3e5b9276c4b2ce0829f48ae5047078/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,060 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:34,061 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2 2023-02-17 22:01:34,061 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae3e5b9276c4b2ce0829f48ae5047078 columnFamilyName f2 2023-02-17 22:01:34,066 DEBUG [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/testWithMockedMapReduceMultiRegion=ae3e5b9276c4b2ce0829f48ae5047078-d745ff12f1694cba960ef4f05253a7b2 2023-02-17 22:01:34,066 INFO [StoreOpener-ae3e5b9276c4b2ce0829f48ae5047078-1] regionserver.HStore(310): Store=ae3e5b9276c4b2ce0829f48ae5047078/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,066 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:34,066 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened ae3e5b9276c4b2ce0829f48ae5047078; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62086028, jitterRate=-0.07484608888626099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:34,066 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:34,078 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing ae3e5b9276c4b2ce0829f48ae5047078, disabling compactions & flushes 2023-02-17 22:01:34,079 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,079 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,079 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. after waiting 0 ms 2023-02-17 22:01:34,079 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,080 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,080 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:34,080 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:34,081 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:34,082 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:34,084 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:34,085 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1 2023-02-17 22:01:34,085 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a854a172d2e2ac6742c4c282ae7c0ec columnFamilyName f1 2023-02-17 22:01:34,090 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/testWithMockedMapReduceMultiRegion=5a854a172d2e2ac6742c4c282ae7c0ec-46e1545242084a8b8e7687fe04319f5a 2023-02-17 22:01:34,090 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(310): Store=5a854a172d2e2ac6742c4c282ae7c0ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,090 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:34,090 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2 2023-02-17 22:01:34,091 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a854a172d2e2ac6742c4c282ae7c0ec columnFamilyName f2 2023-02-17 22:01:34,094 DEBUG [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/testWithMockedMapReduceMultiRegion=5a854a172d2e2ac6742c4c282ae7c0ec-bbc6c16b7d2b4f239251cbb562b54448 2023-02-17 22:01:34,094 INFO [StoreOpener-5a854a172d2e2ac6742c4c282ae7c0ec-1] regionserver.HStore(310): Store=5a854a172d2e2ac6742c4c282ae7c0ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,094 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:34,094 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened 5a854a172d2e2ac6742c4c282ae7c0ec; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73273105, jitterRate=0.09185434877872467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:34,094 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:34,104 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing 5a854a172d2e2ac6742c4c282ae7c0ec, disabling compactions & flushes 2023-02-17 22:01:34,104 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,105 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,105 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. after waiting 0 ms 2023-02-17 22:01:34,105 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,105 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,105 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:34,106 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:34,106 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:34,109 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:34,112 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:34,113 DEBUG [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f1 2023-02-17 22:01:34,113 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e769228ddcfcd2e056e78afd36bf36c1 columnFamilyName f1 2023-02-17 22:01:34,114 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(310): Store=e769228ddcfcd2e056e78afd36bf36c1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,114 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:34,115 DEBUG [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f2 2023-02-17 22:01:34,116 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e769228ddcfcd2e056e78afd36bf36c1 columnFamilyName f2 2023-02-17 22:01:34,116 INFO [StoreOpener-e769228ddcfcd2e056e78afd36bf36c1-1] regionserver.HStore(310): Store=e769228ddcfcd2e056e78afd36bf36c1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,116 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:34,116 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened e769228ddcfcd2e056e78afd36bf36c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64869725, jitterRate=-0.03336577117443085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:34,116 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:34,117 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing e769228ddcfcd2e056e78afd36bf36c1, disabling compactions & flushes 2023-02-17 22:01:34,117 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,117 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,117 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. after waiting 0 ms 2023-02-17 22:01:34,117 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,117 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,117 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:34,118 DEBUG [Listener at localhost/37939] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:34,118 INFO [Listener at localhost/37939] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:34,119 DEBUG [Listener at localhost/37939] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:34,121 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:34,122 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1 2023-02-17 22:01:34,122 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca3415a69d18dcbc6206c6bd541b8095 columnFamilyName f1 2023-02-17 22:01:34,128 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/testWithMockedMapReduceMultiRegion=ca3415a69d18dcbc6206c6bd541b8095-3da74ab5e64c48c28c31908758f21548 2023-02-17 22:01:34,128 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(310): Store=ca3415a69d18dcbc6206c6bd541b8095/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,128 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:34,129 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2 2023-02-17 22:01:34,129 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca3415a69d18dcbc6206c6bd541b8095 columnFamilyName f2 2023-02-17 22:01:34,134 DEBUG [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(539): loaded hdfs://localhost:46207/user/jenkins/test-data/84590841-8a79-adc6-918a-76ce6770c8c0/testWithMockedMapReduceMultiRegion/b43c483d-14ec-4fc6-b723-72081bf17126/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/testWithMockedMapReduceMultiRegion=ca3415a69d18dcbc6206c6bd541b8095-baa9ea1bfea344988193412faed8a3a2 2023-02-17 22:01:34,134 INFO [StoreOpener-ca3415a69d18dcbc6206c6bd541b8095-1] regionserver.HStore(310): Store=ca3415a69d18dcbc6206c6bd541b8095/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:34,134 DEBUG [Listener at localhost/37939] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:34,134 INFO [Listener at localhost/37939] regionserver.HRegion(1071): Opened ca3415a69d18dcbc6206c6bd541b8095; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68152198, jitterRate=0.01554688811302185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:34,134 DEBUG [Listener at localhost/37939] regionserver.HRegion(964): Region open journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:34,147 DEBUG [Listener at localhost/37939] regionserver.HRegion(1603): Closing ca3415a69d18dcbc6206c6bd541b8095, disabling compactions & flushes 2023-02-17 22:01:34,147 INFO [Listener at localhost/37939] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,147 DEBUG [Listener at localhost/37939] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,147 DEBUG [Listener at localhost/37939] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. after waiting 0 ms 2023-02-17 22:01:34,147 DEBUG [Listener at localhost/37939] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,148 INFO [Listener at localhost/37939] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,148 DEBUG [Listener at localhost/37939] regionserver.HRegion(1557): Region close journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:34,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-17 22:01:34,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,158 INFO [Listener at localhost/37939] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,163 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671294162"}]},"ts":"1676671294162"} 2023-02-17 22:01:34,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:34,164 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-17 22:01:34,166 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-17 22:01:34,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, UNASSIGN}] 2023-02-17 22:01:34,169 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, UNASSIGN 2023-02-17 22:01:34,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, UNASSIGN 2023-02-17 22:01:34,169 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, UNASSIGN 2023-02-17 22:01:34,169 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, UNASSIGN 2023-02-17 22:01:34,169 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=0418ab664c892c2595c8d9aec2d31305, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, UNASSIGN 2023-02-17 22:01:34,169 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671294169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294169"}]},"ts":"1676671294169"} 2023-02-17 22:01:34,170 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1c6f8fceaaceac68b610dc7f69083f25, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2c75ba8309d7fb83e9c48f0c33154468, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,170 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294170"}]},"ts":"1676671294170"} 2023-02-17 22:01:34,170 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294170"}]},"ts":"1676671294170"} 2023-02-17 22:01:34,170 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e769228ddcfcd2e056e78afd36bf36c1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,170 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671294170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294170"}]},"ts":"1676671294170"} 2023-02-17 22:01:34,170 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ae3e5b9276c4b2ce0829f48ae5047078, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,171 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294170"}]},"ts":"1676671294170"} 2023-02-17 22:01:34,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure 0418ab664c892c2595c8d9aec2d31305, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:34,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure 1c6f8fceaaceac68b610dc7f69083f25, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:34,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure 2c75ba8309d7fb83e9c48f0c33154468, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:34,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure e769228ddcfcd2e056e78afd36bf36c1, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:34,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=37, state=RUNNABLE; CloseRegionProcedure ae3e5b9276c4b2ce0829f48ae5047078, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:34,175 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, UNASSIGN 2023-02-17 22:01:34,175 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, UNASSIGN 2023-02-17 22:01:34,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5a854a172d2e2ac6742c4c282ae7c0ec, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,176 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294176"}]},"ts":"1676671294176"} 2023-02-17 22:01:34,176 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, UNASSIGN 2023-02-17 22:01:34,176 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=6afee56be47150e82bd109b76cca52fb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294176"}]},"ts":"1676671294176"} 2023-02-17 22:01:34,177 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, UNASSIGN 2023-02-17 22:01:34,177 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ca3415a69d18dcbc6206c6bd541b8095, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,177 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294177"}]},"ts":"1676671294177"} 2023-02-17 22:01:34,177 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, UNASSIGN 2023-02-17 22:01:34,177 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=0c80d785b8b0fee20fae3c6c1bb123ae, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 5a854a172d2e2ac6742c4c282ae7c0ec, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:34,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294177"}]},"ts":"1676671294177"} 2023-02-17 22:01:34,178 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,178 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294178"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671294178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671294178"}]},"ts":"1676671294178"} 2023-02-17 22:01:34,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 6afee56be47150e82bd109b76cca52fb, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:34,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure ca3415a69d18dcbc6206c6bd541b8095, server=jenkins-hbase9.apache.org,45431,1676671289640}] 2023-02-17 22:01:34,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 0c80d785b8b0fee20fae3c6c1bb123ae, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:34,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, server=jenkins-hbase9.apache.org,35117,1676671289663}] 2023-02-17 22:01:34,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:34,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:34,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 0418ab664c892c2595c8d9aec2d31305, disabling compactions & flushes 2023-02-17 22:01:34,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. after waiting 0 ms 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:34,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, disabling compactions & flushes 2023-02-17 22:01:34,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. after waiting 0 ms 2023-02-17 22:01:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 22:01:34,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305. 2023-02-17 22:01:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 0418ab664c892c2595c8d9aec2d31305: 2023-02-17 22:01:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079. 2023-02-17 22:01:34,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079: 2023-02-17 22:01:34,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:34,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:34,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 5a854a172d2e2ac6742c4c282ae7c0ec, disabling compactions & flushes 2023-02-17 22:01:34,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. after waiting 0 ms 2023-02-17 22:01:34,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=0418ab664c892c2595c8d9aec2d31305, regionState=CLOSED 2023-02-17 22:01:34,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671294331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294331"}]},"ts":"1676671294331"} 2023-02-17 22:01:34,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:34,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:34,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 2c75ba8309d7fb83e9c48f0c33154468, disabling compactions & flushes 2023-02-17 22:01:34,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:34,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:34,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. after waiting 0 ms 2023-02-17 22:01:34,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:34,331 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, regionState=CLOSED 2023-02-17 22:01:34,331 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294331"}]},"ts":"1676671294331"} 2023-02-17 22:01:34,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-17 22:01:34,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure 0418ab664c892c2595c8d9aec2d31305, server=jenkins-hbase9.apache.org,45431,1676671289640 in 161 msec 2023-02-17 22:01:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-17 22:01:34,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, server=jenkins-hbase9.apache.org,35117,1676671289663 in 148 msec 2023-02-17 22:01:34,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec. 2023-02-17 22:01:34,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 5a854a172d2e2ac6742c4c282ae7c0ec: 2023-02-17 22:01:34,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0418ab664c892c2595c8d9aec2d31305, UNASSIGN in 168 msec 2023-02-17 22:01:34,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468. 2023-02-17 22:01:34,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 2c75ba8309d7fb83e9c48f0c33154468: 2023-02-17 22:01:34,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, UNASSIGN in 169 msec 2023-02-17 22:01:34,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:34,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:34,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing ca3415a69d18dcbc6206c6bd541b8095, disabling compactions & flushes 2023-02-17 22:01:34,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. after waiting 0 ms 2023-02-17 22:01:34,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5a854a172d2e2ac6742c4c282ae7c0ec, regionState=CLOSED 2023-02-17 22:01:34,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294336"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294336"}]},"ts":"1676671294336"} 2023-02-17 22:01:34,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:34,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:34,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 6afee56be47150e82bd109b76cca52fb, disabling compactions & flushes 2023-02-17 22:01:34,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. after waiting 0 ms 2023-02-17 22:01:34,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,337 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2c75ba8309d7fb83e9c48f0c33154468, regionState=CLOSED 2023-02-17 22:01:34,337 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294337"}]},"ts":"1676671294337"} 2023-02-17 22:01:34,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-17 22:01:34,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 5a854a172d2e2ac6742c4c282ae7c0ec, server=jenkins-hbase9.apache.org,45431,1676671289640 in 161 msec 2023-02-17 22:01:34,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-17 22:01:34,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure 2c75ba8309d7fb83e9c48f0c33154468, server=jenkins-hbase9.apache.org,35117,1676671289663 in 165 msec 2023-02-17 22:01:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5a854a172d2e2ac6742c4c282ae7c0ec, UNASSIGN in 174 msec 2023-02-17 22:01:34,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c75ba8309d7fb83e9c48f0c33154468, UNASSIGN in 174 msec 2023-02-17 22:01:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095. 2023-02-17 22:01:34,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for ca3415a69d18dcbc6206c6bd541b8095: 2023-02-17 22:01:34,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb. 2023-02-17 22:01:34,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 6afee56be47150e82bd109b76cca52fb: 2023-02-17 22:01:34,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:34,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing ae3e5b9276c4b2ce0829f48ae5047078, disabling compactions & flushes 2023-02-17 22:01:34,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. after waiting 0 ms 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,343 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ca3415a69d18dcbc6206c6bd541b8095, regionState=CLOSED 2023-02-17 22:01:34,343 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294343"}]},"ts":"1676671294343"} 2023-02-17 22:01:34,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:34,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 0c80d785b8b0fee20fae3c6c1bb123ae, disabling compactions & flushes 2023-02-17 22:01:34,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. after waiting 0 ms 2023-02-17 22:01:34,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:34,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=6afee56be47150e82bd109b76cca52fb, regionState=CLOSED 2023-02-17 22:01:34,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294343"}]},"ts":"1676671294343"} 2023-02-17 22:01:34,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-17 22:01:34,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure ca3415a69d18dcbc6206c6bd541b8095, server=jenkins-hbase9.apache.org,45431,1676671289640 in 164 msec 2023-02-17 22:01:34,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-17 22:01:34,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 6afee56be47150e82bd109b76cca52fb, server=jenkins-hbase9.apache.org,35117,1676671289663 in 166 msec 2023-02-17 22:01:34,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ca3415a69d18dcbc6206c6bd541b8095, UNASSIGN in 180 msec 2023-02-17 22:01:34,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6afee56be47150e82bd109b76cca52fb, UNASSIGN in 180 msec 2023-02-17 22:01:34,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078. 2023-02-17 22:01:34,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for ae3e5b9276c4b2ce0829f48ae5047078: 2023-02-17 22:01:34,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae. 2023-02-17 22:01:34,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 0c80d785b8b0fee20fae3c6c1bb123ae: 2023-02-17 22:01:34,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:34,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:34,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1c6f8fceaaceac68b610dc7f69083f25, disabling compactions & flushes 2023-02-17 22:01:34,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:34,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:34,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. after waiting 0 ms 2023-02-17 22:01:34,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:34,350 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=ae3e5b9276c4b2ce0829f48ae5047078, regionState=CLOSED 2023-02-17 22:01:34,350 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294350"}]},"ts":"1676671294350"} 2023-02-17 22:01:34,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:34,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:34,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e769228ddcfcd2e056e78afd36bf36c1, disabling compactions & flushes 2023-02-17 22:01:34,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. after waiting 0 ms 2023-02-17 22:01:34,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,350 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=0c80d785b8b0fee20fae3c6c1bb123ae, regionState=CLOSED 2023-02-17 22:01:34,350 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294350"}]},"ts":"1676671294350"} 2023-02-17 22:01:34,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=37 2023-02-17 22:01:34,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=37, state=SUCCESS; CloseRegionProcedure ae3e5b9276c4b2ce0829f48ae5047078, server=jenkins-hbase9.apache.org,45431,1676671289640 in 177 msec 2023-02-17 22:01:34,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:34,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25. 2023-02-17 22:01:34,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1c6f8fceaaceac68b610dc7f69083f25: 2023-02-17 22:01:34,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-17 22:01:34,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 22:01:34,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 0c80d785b8b0fee20fae3c6c1bb123ae, server=jenkins-hbase9.apache.org,35117,1676671289663 in 171 msec 2023-02-17 22:01:34,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae3e5b9276c4b2ce0829f48ae5047078, UNASSIGN in 187 msec 2023-02-17 22:01:34,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0c80d785b8b0fee20fae3c6c1bb123ae, UNASSIGN in 193 msec 2023-02-17 22:01:34,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1. 2023-02-17 22:01:34,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e769228ddcfcd2e056e78afd36bf36c1: 2023-02-17 22:01:34,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:34,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1c6f8fceaaceac68b610dc7f69083f25, regionState=CLOSED 2023-02-17 22:01:34,368 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676671294367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294367"}]},"ts":"1676671294367"} 2023-02-17 22:01:34,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:34,368 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e769228ddcfcd2e056e78afd36bf36c1, regionState=CLOSED 2023-02-17 22:01:34,369 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676671294368"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671294368"}]},"ts":"1676671294368"} 2023-02-17 22:01:34,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-17 22:01:34,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure 1c6f8fceaaceac68b610dc7f69083f25, server=jenkins-hbase9.apache.org,45431,1676671289640 in 197 msec 2023-02-17 22:01:34,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-17 22:01:34,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure e769228ddcfcd2e056e78afd36bf36c1, server=jenkins-hbase9.apache.org,35117,1676671289663 in 196 msec 2023-02-17 22:01:34,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1c6f8fceaaceac68b610dc7f69083f25, UNASSIGN in 205 msec 2023-02-17 22:01:34,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-17 22:01:34,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e769228ddcfcd2e056e78afd36bf36c1, UNASSIGN in 206 msec 2023-02-17 22:01:34,373 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671294373"}]},"ts":"1676671294373"} 2023-02-17 22:01:34,375 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-17 22:01:34,377 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-17 22:01:34,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 219 msec 2023-02-17 22:01:34,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 22:01:34,467 INFO [Listener at localhost/37939] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-17 22:01:34,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,471 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,472 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 22:01:34,484 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:34,485 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:34,489 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/recovered.edits] 2023-02-17 22:01:34,489 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/recovered.edits] 2023-02-17 22:01:34,490 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/recovered.edits] 2023-02-17 22:01:34,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/recovered.edits] 2023-02-17 22:01:34,493 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/recovered.edits] 2023-02-17 22:01:34,493 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/recovered.edits] 2023-02-17 22:01:34,493 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/recovered.edits] 2023-02-17 22:01:34,493 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/recovered.edits] 2023-02-17 22:01:34,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/69ccb2fcaa7744469afe67ab42c325e0 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/69ccb2fcaa7744469afe67ab42c325e0 2023-02-17 22:01:34,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/235d7d280ddb40eba52476e38ac41a30 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/235d7d280ddb40eba52476e38ac41a30 2023-02-17 22:01:34,501 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/72272420b45e4f628ecbf59e3b43be3f to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/72272420b45e4f628ecbf59e3b43be3f 2023-02-17 22:01:34,502 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/7dc1956137da4accb36fea4127833347 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/7dc1956137da4accb36fea4127833347 2023-02-17 22:01:34,503 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/2683146a97614c4eaa06698569f9819c to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/2683146a97614c4eaa06698569f9819c 2023-02-17 22:01:34,503 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/363ee235ba524e0b9236f3c864b9e192 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/363ee235ba524e0b9236f3c864b9e192 2023-02-17 22:01:34,503 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/7d7cbc85954a43fd86a538cfded381dc to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f1/7d7cbc85954a43fd86a538cfded381dc 2023-02-17 22:01:34,504 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/1645d6542c3b47028a3e056ca4fb06d7 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/1645d6542c3b47028a3e056ca4fb06d7 2023-02-17 22:01:34,504 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/7acc5f6a8f10440c93ff89b0742ca9a3 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f1/7acc5f6a8f10440c93ff89b0742ca9a3 2023-02-17 22:01:34,505 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/e8eeae10cba04ec6af5763017fc7b59c to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f1/e8eeae10cba04ec6af5763017fc7b59c 2023-02-17 22:01:34,506 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/94cfc298d7f34188a17c6666ac56d91f to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f1/94cfc298d7f34188a17c6666ac56d91f 2023-02-17 22:01:34,506 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/recovered.edits/6.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305/recovered.edits/6.seqid 2023-02-17 22:01:34,507 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/6b2b2aed3f2041f7a7266733b864f62b to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f1/6b2b2aed3f2041f7a7266733b864f62b 2023-02-17 22:01:34,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0418ab664c892c2595c8d9aec2d31305 2023-02-17 22:01:34,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:34,507 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/3da74ab5e64c48c28c31908758f21548 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f1/3da74ab5e64c48c28c31908758f21548 2023-02-17 22:01:34,508 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/d2f7b712a13240b6bfe23a8604028dce to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f1/d2f7b712a13240b6bfe23a8604028dce 2023-02-17 22:01:34,510 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/7c6b2432afca489385e34eabc2c3c188 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/7c6b2432afca489385e34eabc2c3c188 2023-02-17 22:01:34,512 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/377210599ce5470eab6dd5886b31d5d3 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/377210599ce5470eab6dd5886b31d5d3 2023-02-17 22:01:34,513 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/32fac1fef0204ea2b073c128af3f4074 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/32fac1fef0204ea2b073c128af3f4074 2023-02-17 22:01:34,513 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/recovered.edits] 2023-02-17 22:01:34,515 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/2f93a779212d4c248e5bdac85ff86f02 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/2f93a779212d4c248e5bdac85ff86f02 2023-02-17 22:01:34,516 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/5ae266d3d2404eb0863be633096b8528 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/5ae266d3d2404eb0863be633096b8528 2023-02-17 22:01:34,516 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/b85fb50afd4f419ba7593b6967de7eb6 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/f2/b85fb50afd4f419ba7593b6967de7eb6 2023-02-17 22:01:34,516 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/8de6d08b361a473894391f92d5331285 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/f2/8de6d08b361a473894391f92d5331285 2023-02-17 22:01:34,516 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/357cebbfed344f31a0754b95eacef914 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/357cebbfed344f31a0754b95eacef914 2023-02-17 22:01:34,519 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/e1bfeac389d74eb68e63161789e21cbd to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/e1bfeac389d74eb68e63161789e21cbd 2023-02-17 22:01:34,519 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/d745ff12f1694cba960ef4f05253a7b2 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/f2/d745ff12f1694cba960ef4f05253a7b2 2023-02-17 22:01:34,519 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/bba2f5658b0e4491a59ce901d124d474 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/f2/bba2f5658b0e4491a59ce901d124d474 2023-02-17 22:01:34,520 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/857069916d93413cb5ac9427724a8609 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/f2/857069916d93413cb5ac9427724a8609 2023-02-17 22:01:34,520 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/baa9ea1bfea344988193412faed8a3a2 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/f2/baa9ea1bfea344988193412faed8a3a2 2023-02-17 22:01:34,523 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/fbf1268f9bd142508b1528602b1ba51f to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/f2/fbf1268f9bd142508b1528602b1ba51f 2023-02-17 22:01:34,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/46e1545242084a8b8e7687fe04319f5a to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/46e1545242084a8b8e7687fe04319f5a 2023-02-17 22:01:34,524 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb/recovered.edits/12.seqid 2023-02-17 22:01:34,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/6afee56be47150e82bd109b76cca52fb 2023-02-17 22:01:34,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:34,526 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078/recovered.edits/12.seqid 2023-02-17 22:01:34,526 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae3e5b9276c4b2ce0829f48ae5047078 2023-02-17 22:01:34,527 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/bee38db06f9d412595fee5b99131238b to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f1/bee38db06f9d412595fee5b99131238b 2023-02-17 22:01:34,527 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25/recovered.edits/12.seqid 2023-02-17 22:01:34,527 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae/recovered.edits/12.seqid 2023-02-17 22:01:34,527 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095/recovered.edits/12.seqid 2023-02-17 22:01:34,528 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/1c6f8fceaaceac68b610dc7f69083f25 2023-02-17 22:01:34,528 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/0c80d785b8b0fee20fae3c6c1bb123ae 2023-02-17 22:01:34,528 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/ca3415a69d18dcbc6206c6bd541b8095 2023-02-17 22:01:34,528 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f1, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/f2, FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/recovered.edits] 2023-02-17 22:01:34,530 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079/recovered.edits/12.seqid 2023-02-17 22:01:34,530 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f0c9b7d6c34b3b9bf3b6a5d1e2f4079 2023-02-17 22:01:34,531 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/bbc6c16b7d2b4f239251cbb562b54448 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/bbc6c16b7d2b4f239251cbb562b54448 2023-02-17 22:01:34,532 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468/recovered.edits/12.seqid 2023-02-17 22:01:34,533 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c75ba8309d7fb83e9c48f0c33154468 2023-02-17 22:01:34,533 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/f307fcb805b54e6fb4011aa9fd0d90e6 to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/f2/f307fcb805b54e6fb4011aa9fd0d90e6 2023-02-17 22:01:34,535 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/recovered.edits/6.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1/recovered.edits/6.seqid 2023-02-17 22:01:34,536 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/e769228ddcfcd2e056e78afd36bf36c1 2023-02-17 22:01:34,537 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/recovered.edits/12.seqid to hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/archive/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec/recovered.edits/12.seqid 2023-02-17 22:01:34,538 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/.tmp/data/default/testWithMockedMapReduceMultiRegion/5a854a172d2e2ac6742c4c282ae7c0ec 2023-02-17 22:01:34,538 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-17 22:01:34,540 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,544 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-17 22:01:34,549 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,551 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,551 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,551 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,551 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,551 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671294550"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,555 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-17 22:01:34,555 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0418ab664c892c2595c8d9aec2d31305, NAME => 'testWithMockedMapReduceMultiRegion,,1676671290798.0418ab664c892c2595c8d9aec2d31305.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 1c6f8fceaaceac68b610dc7f69083f25, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676671290798.1c6f8fceaaceac68b610dc7f69083f25.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 7f0c9b7d6c34b3b9bf3b6a5d1e2f4079, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676671290798.7f0c9b7d6c34b3b9bf3b6a5d1e2f4079.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => ae3e5b9276c4b2ce0829f48ae5047078, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676671290798.ae3e5b9276c4b2ce0829f48ae5047078.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 2c75ba8309d7fb83e9c48f0c33154468, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676671290798.2c75ba8309d7fb83e9c48f0c33154468.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 0c80d785b8b0fee20fae3c6c1bb123ae, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676671290798.0c80d785b8b0fee20fae3c6c1bb123ae.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => ca3415a69d18dcbc6206c6bd541b8095, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676671290798.ca3415a69d18dcbc6206c6bd541b8095.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 6afee56be47150e82bd109b76cca52fb, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676671290798.6afee56be47150e82bd109b76cca52fb.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 5a854a172d2e2ac6742c4c282ae7c0ec, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676671290798.5a854a172d2e2ac6742c4c282ae7c0ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => e769228ddcfcd2e056e78afd36bf36c1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676671290798.e769228ddcfcd2e056e78afd36bf36c1.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-17 22:01:34,555 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-17 22:01:34,555 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676671294555"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:34,556 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-17 22:01:34,558 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 22:01:34,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 90 msec 2023-02-17 22:01:34,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35957] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 22:01:34,574 INFO [Listener at localhost/37939] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-17 22:01:34,574 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:34,574 INFO [Listener at localhost/37939] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:34,575 DEBUG [Listener at localhost/37939] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b67dd44 to 127.0.0.1:58480 2023-02-17 22:01:34,575 DEBUG [Listener at localhost/37939] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,575 DEBUG [Listener at localhost/37939] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:34,575 DEBUG [Listener at localhost/37939] util.JVMClusterUtil(257): Found active master hash=1433765211, stopped=false 2023-02-17 22:01:34,575 INFO [Listener at localhost/37939] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:34,577 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:34,577 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:34,577 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:34,577 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:34,577 INFO [Listener at localhost/37939] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:34,579 DEBUG [Listener at localhost/37939] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51fcd95e to 127.0.0.1:58480 2023-02-17 22:01:34,580 DEBUG [Listener at localhost/37939] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,580 INFO [Listener at localhost/37939] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45431,1676671289640' ***** 2023-02-17 22:01:34,580 INFO [Listener at localhost/37939] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:34,580 INFO [Listener at localhost/37939] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35117,1676671289663' ***** 2023-02-17 22:01:34,580 INFO [Listener at localhost/37939] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:34,580 INFO [RS:0;jenkins-hbase9:45431] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:34,580 INFO [RS:0;jenkins-hbase9:45431] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:34,580 INFO [RS:1;jenkins-hbase9:35117] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:34,580 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:34,580 INFO [RS:1;jenkins-hbase9:35117] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:34,580 INFO [RS:0;jenkins-hbase9:45431] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:34,581 INFO [RS:1;jenkins-hbase9:35117] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:34,581 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:34,582 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(3304): Received CLOSE for d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:34,582 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,583 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,583 DEBUG [RS:0;jenkins-hbase9:45431] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30cdc088 to 127.0.0.1:58480 2023-02-17 22:01:34,583 DEBUG [RS:1;jenkins-hbase9:35117] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c73689a to 127.0.0.1:58480 2023-02-17 22:01:34,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d350442a2642ac17dfb6fbaa2a04e001, disabling compactions & flushes 2023-02-17 22:01:34,583 DEBUG [RS:1;jenkins-hbase9:35117] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,583 DEBUG [RS:0;jenkins-hbase9:45431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,584 INFO [RS:1;jenkins-hbase9:35117] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:34,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:34,584 INFO [RS:1;jenkins-hbase9:35117] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:34,584 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45431,1676671289640; all regions closed. 2023-02-17 22:01:34,584 INFO [RS:1;jenkins-hbase9:35117] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:34,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:34,584 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:34,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. after waiting 0 ms 2023-02-17 22:01:34,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:34,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing d350442a2642ac17dfb6fbaa2a04e001 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:34,586 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 22:01:34,586 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1479): Online Regions={d350442a2642ac17dfb6fbaa2a04e001=hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001., 1588230740=hbase:meta,,1.1588230740} 2023-02-17 22:01:34,586 DEBUG [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1505): Waiting on 1588230740, d350442a2642ac17dfb6fbaa2a04e001 2023-02-17 22:01:34,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:34,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:34,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:34,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:34,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:34,589 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-17 22:01:34,592 DEBUG [RS:0;jenkins-hbase9:45431] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/oldWALs 2023-02-17 22:01:34,592 INFO [RS:0;jenkins-hbase9:45431] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45431%2C1676671289640:(num 1676671290961) 2023-02-17 22:01:34,592 DEBUG [RS:0;jenkins-hbase9:45431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,592 INFO [RS:0;jenkins-hbase9:45431] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:34,592 INFO [RS:0;jenkins-hbase9:45431] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:34,592 INFO [RS:0;jenkins-hbase9:45431] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:34,592 INFO [RS:0;jenkins-hbase9:45431] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:34,592 INFO [RS:0;jenkins-hbase9:45431] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:34,592 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:34,593 INFO [RS:0;jenkins-hbase9:45431] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45431 2023-02-17 22:01:34,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/.tmp/info/3035ac7f4b5d4ecf93af6342a9922030 2023-02-17 22:01:34,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/.tmp/info/3035ac7f4b5d4ecf93af6342a9922030 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/info/3035ac7f4b5d4ecf93af6342a9922030 2023-02-17 22:01:34,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/.tmp/info/0d246ca5fbec492f81f5ee34aae6331e 2023-02-17 22:01:34,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/info/3035ac7f4b5d4ecf93af6342a9922030, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:34,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d350442a2642ac17dfb6fbaa2a04e001 in 26ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:34,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d246ca5fbec492f81f5ee34aae6331e 2023-02-17 22:01:34,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/namespace/d350442a2642ac17dfb6fbaa2a04e001/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:34,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:34,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d350442a2642ac17dfb6fbaa2a04e001: 2023-02-17 22:01:34,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671290257.d350442a2642ac17dfb6fbaa2a04e001. 2023-02-17 22:01:34,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/.tmp/rep_barrier/fdc2c381de8f469da7544b7f6ef77de2 2023-02-17 22:01:34,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdc2c381de8f469da7544b7f6ef77de2 2023-02-17 22:01:34,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/.tmp/table/25468e73abae4a4597cd8935bb476e36 2023-02-17 22:01:34,632 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25468e73abae4a4597cd8935bb476e36 2023-02-17 22:01:34,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/.tmp/info/0d246ca5fbec492f81f5ee34aae6331e as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/info/0d246ca5fbec492f81f5ee34aae6331e 2023-02-17 22:01:34,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d246ca5fbec492f81f5ee34aae6331e 2023-02-17 22:01:34,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/info/0d246ca5fbec492f81f5ee34aae6331e, entries=30, sequenceid=57, filesize=8.3 K 2023-02-17 22:01:34,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/.tmp/rep_barrier/fdc2c381de8f469da7544b7f6ef77de2 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/rep_barrier/fdc2c381de8f469da7544b7f6ef77de2 2023-02-17 22:01:34,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdc2c381de8f469da7544b7f6ef77de2 2023-02-17 22:01:34,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/rep_barrier/fdc2c381de8f469da7544b7f6ef77de2, entries=10, sequenceid=57, filesize=6.1 K 2023-02-17 22:01:34,643 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/.tmp/table/25468e73abae4a4597cd8935bb476e36 as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/table/25468e73abae4a4597cd8935bb476e36 2023-02-17 22:01:34,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25468e73abae4a4597cd8935bb476e36 2023-02-17 22:01:34,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/table/25468e73abae4a4597cd8935bb476e36, entries=13, sequenceid=57, filesize=6.1 K 2023-02-17 22:01:34,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=57, compaction requested=false 2023-02-17 22:01:34,654 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-17 22:01:34,654 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:34,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:34,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:34,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:34,667 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:34,668 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:34,679 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:34,679 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,679 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:34,679 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45431,1676671289640 2023-02-17 22:01:34,679 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:34,679 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d2418ba rejected from java.util.concurrent.ThreadPoolExecutor@391b8bc6[Shutting down, pool size = 1, active threads = 1, queued tasks = 1, completed tasks = 15] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:34,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:34,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:34,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:34,684 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45431,1676671289640] 2023-02-17 22:01:34,684 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45431,1676671289640; numProcessing=1 2023-02-17 22:01:34,688 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45431,1676671289640 already deleted, retry=false 2023-02-17 22:01:34,688 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45431,1676671289640 expired; onlineServers=1 2023-02-17 22:01:34,786 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35117,1676671289663; all regions closed. 2023-02-17 22:01:34,791 DEBUG [RS:1;jenkins-hbase9:35117] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/oldWALs 2023-02-17 22:01:34,791 INFO [RS:1;jenkins-hbase9:35117] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35117%2C1676671289663.meta:.meta(num 1676671290203) 2023-02-17 22:01:34,794 DEBUG [RS:1;jenkins-hbase9:35117] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/oldWALs 2023-02-17 22:01:34,794 INFO [RS:1;jenkins-hbase9:35117] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35117%2C1676671289663:(num 1676671290616) 2023-02-17 22:01:34,794 DEBUG [RS:1;jenkins-hbase9:35117] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,794 INFO [RS:1;jenkins-hbase9:35117] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:34,794 INFO [RS:1;jenkins-hbase9:35117] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:34,794 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:34,795 INFO [RS:1;jenkins-hbase9:35117] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35117 2023-02-17 22:01:34,797 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35117,1676671289663 2023-02-17 22:01:34,797 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:34,797 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bf865c7 rejected from java.util.concurrent.ThreadPoolExecutor@4fc7f860[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:34,798 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35117,1676671289663] 2023-02-17 22:01:34,798 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35117,1676671289663; numProcessing=2 2023-02-17 22:01:34,801 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35117,1676671289663 already deleted, retry=false 2023-02-17 22:01:34,801 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35117,1676671289663 expired; onlineServers=0 2023-02-17 22:01:34,801 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,35957,1676671289575' ***** 2023-02-17 22:01:34,801 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:34,802 DEBUG [M:0;jenkins-hbase9:35957] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@514a0b2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:34,802 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,35957,1676671289575 2023-02-17 22:01:34,802 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,35957,1676671289575; all regions closed. 2023-02-17 22:01:34,802 DEBUG [M:0;jenkins-hbase9:35957] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:34,802 DEBUG [M:0;jenkins-hbase9:35957] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:34,802 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:34,802 DEBUG [M:0;jenkins-hbase9:35957] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:34,802 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671289828] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671289828,5,FailOnTimeoutGroup] 2023-02-17 22:01:34,802 INFO [M:0;jenkins-hbase9:35957] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:34,802 INFO [M:0;jenkins-hbase9:35957] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:34,802 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671289828] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671289828,5,FailOnTimeoutGroup] 2023-02-17 22:01:34,803 INFO [M:0;jenkins-hbase9:35957] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:34,803 DEBUG [M:0;jenkins-hbase9:35957] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:34,803 INFO [M:0;jenkins-hbase9:35957] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:34,803 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:34,803 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:34,804 ERROR [M:0;jenkins-hbase9:35957] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 22:01:34,804 INFO [M:0;jenkins-hbase9:35957] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:34,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:34,804 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:34,804 DEBUG [M:0;jenkins-hbase9:35957] zookeeper.ZKUtil(398): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:34,804 WARN [M:0;jenkins-hbase9:35957] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:34,804 INFO [M:0;jenkins-hbase9:35957] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:34,805 INFO [M:0;jenkins-hbase9:35957] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:34,805 DEBUG [M:0;jenkins-hbase9:35957] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:34,805 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:34,805 DEBUG [M:0;jenkins-hbase9:35957] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:34,805 DEBUG [M:0;jenkins-hbase9:35957] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:34,805 DEBUG [M:0;jenkins-hbase9:35957] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:34,805 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-17 22:01:34,813 INFO [M:0;jenkins-hbase9:35957] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/098909f9aa0543eaa090cc5dbf88c44f 2023-02-17 22:01:34,816 DEBUG [M:0;jenkins-hbase9:35957] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/098909f9aa0543eaa090cc5dbf88c44f as hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/098909f9aa0543eaa090cc5dbf88c44f 2023-02-17 22:01:34,820 INFO [M:0;jenkins-hbase9:35957] regionserver.HStore(1080): Added hdfs://localhost:46207/user/jenkins/test-data/58990eb7-f152-5885-89cc-6c87f6f35866/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/098909f9aa0543eaa090cc5dbf88c44f, entries=53, sequenceid=357, filesize=10.7 K 2023-02-17 22:01:34,820 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171154, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false 2023-02-17 22:01:34,821 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:34,821 DEBUG [M:0;jenkins-hbase9:35957] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:34,823 INFO [M:0;jenkins-hbase9:35957] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:34,823 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:34,824 INFO [M:0;jenkins-hbase9:35957] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35957 2023-02-17 22:01:34,826 DEBUG [M:0;jenkins-hbase9:35957] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35957,1676671289575 already deleted, retry=false 2023-02-17 22:01:34,879 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:34,879 INFO [RS:0;jenkins-hbase9:45431] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45431,1676671289640; zookeeper connection closed. 2023-02-17 22:01:34,879 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50d3bbe4 rejected from java.util.concurrent.ThreadPoolExecutor@391b8bc6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:34,879 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:45431-0x100644e68830001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:34,879 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@656ada50] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@656ada50 2023-02-17 22:01:34,879 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@288f7f44 rejected from java.util.concurrent.ThreadPoolExecutor@391b8bc6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:35,180 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:35,180 INFO [M:0;jenkins-hbase9:35957] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35957,1676671289575; zookeeper connection closed. 2023-02-17 22:01:35,181 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fe4ff8a rejected from java.util.concurrent.ThreadPoolExecutor@5bdb60ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:35,181 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): master:35957-0x100644e68830000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:35,182 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57ed604f rejected from java.util.concurrent.ThreadPoolExecutor@5bdb60ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:35,281 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:35,281 INFO [RS:1;jenkins-hbase9:35117] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,35117,1676671289663; zookeeper connection closed. 2023-02-17 22:01:35,281 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33dbcaa7 rejected from java.util.concurrent.ThreadPoolExecutor@4fc7f860[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:35,281 DEBUG [Listener at localhost/37939-EventThread] zookeeper.ZKWatcher(600): regionserver:35117-0x100644e68830002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:35,281 ERROR [Listener at localhost/37939-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bf1bcbe rejected from java.util.concurrent.ThreadPoolExecutor@4fc7f860[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:35,281 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ca8b44d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ca8b44d 2023-02-17 22:01:35,282 INFO [Listener at localhost/37939] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:35,282 WARN [Listener at localhost/37939] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:35,285 INFO [Listener at localhost/37939] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:35,395 WARN [BP-422652918-172.31.2.10-1676671288841 heartbeating to localhost/127.0.0.1:46207] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:35,395 WARN [BP-422652918-172.31.2.10-1676671288841 heartbeating to localhost/127.0.0.1:46207] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-422652918-172.31.2.10-1676671288841 (Datanode Uuid c8ac3264-d7c7-47de-b0b2-03b014ece1b6) service to localhost/127.0.0.1:46207 2023-02-17 22:01:35,396 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/dfs/data/data3/current/BP-422652918-172.31.2.10-1676671288841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:35,397 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/dfs/data/data4/current/BP-422652918-172.31.2.10-1676671288841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:35,398 WARN [Listener at localhost/37939] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:35,400 INFO [Listener at localhost/37939] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:35,507 WARN [BP-422652918-172.31.2.10-1676671288841 heartbeating to localhost/127.0.0.1:46207] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:35,507 WARN [BP-422652918-172.31.2.10-1676671288841 heartbeating to localhost/127.0.0.1:46207] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-422652918-172.31.2.10-1676671288841 (Datanode Uuid 32491a28-6e79-4586-b068-70bf57f5af79) service to localhost/127.0.0.1:46207 2023-02-17 22:01:35,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/dfs/data/data1/current/BP-422652918-172.31.2.10-1676671288841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:35,509 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/cluster_7cdaf2a4-cd95-f852-b543-f00c5d728c58/dfs/data/data2/current/BP-422652918-172.31.2.10-1676671288841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:35,519 INFO [Listener at localhost/37939] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:35,639 INFO [Listener at localhost/37939] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:35,678 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:35,694 INFO [Listener at localhost/37939] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=227 (was 176) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:46207 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,35957,1676671289575)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:46207 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:46207 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:46207 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:46207 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:46207 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46207 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37939.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=632 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=295 (was 314), ProcessCount=171 (was 173), AvailableMemoryMB=6744 (was 6868) 2023-02-17 22:01:35,703 INFO [Listener at localhost/37939] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=227, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=295, ProcessCount=171, AvailableMemoryMB=6743 2023-02-17 22:01:35,714 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/hadoop.log.dir so I do NOT create it in target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4 2023-02-17 22:01:35,714 WARN [Listener at localhost/37939] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 22:01:35,714 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/hadoop.tmp.dir so I do NOT create it in target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4 2023-02-17 22:01:35,714 WARN [Listener at localhost/37939] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb43fc8-670f-4061-ca6a-8e097c61476b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 22:01:35,714 DEBUG [Listener at localhost/37939] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4 2023-02-17 22:01:35,714 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:01:35,714 INFO [Listener at localhost/37939] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d, deleteOnExit=true 2023-02-17 22:01:35,714 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/test.cache.data in system properties and HBase conf 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:01:35,715 DEBUG [Listener at localhost/37939] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:35,715 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:01:35,716 INFO [Listener at localhost/37939] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:01:35,721 WARN [Listener at localhost/37939] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:35,721 WARN [Listener at localhost/37939] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:35,722 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 22:01:35,807 WARN [Listener at localhost/37939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:35,809 INFO [Listener at localhost/37939] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:35,815 INFO [Listener at localhost/37939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/java.io.tmpdir/Jetty_localhost_46069_hdfs____.i2l8v9/webapp 2023-02-17 22:01:35,915 INFO [Listener at localhost/37939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46069 2023-02-17 22:01:35,920 WARN [Listener at localhost/37939] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:35,920 WARN [Listener at localhost/37939] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:35,975 WARN [Listener at localhost/38957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:36,004 WARN [Listener at localhost/38957] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:36,007 WARN [Listener at localhost/38957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:36,008 INFO [Listener at localhost/38957] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:36,019 INFO [Listener at localhost/38957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/java.io.tmpdir/Jetty_localhost_38627_datanode____m46tel/webapp 2023-02-17 22:01:36,114 INFO [Listener at localhost/38957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38627 2023-02-17 22:01:36,123 WARN [Listener at localhost/36947] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:36,141 WARN [Listener at localhost/36947] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:36,143 WARN [Listener at localhost/36947] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:36,144 INFO [Listener at localhost/36947] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:36,150 INFO [Listener at localhost/36947] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/java.io.tmpdir/Jetty_localhost_36809_datanode____ouqeat/webapp 2023-02-17 22:01:36,241 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xffa6501cebec6e6d: Processing first storage report for DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200 from datanode 5730eb43-9d7d-45de-8163-e479e7831378 2023-02-17 22:01:36,241 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xffa6501cebec6e6d: from storage DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200 node DatanodeRegistration(127.0.0.1:41197, datanodeUuid=5730eb43-9d7d-45de-8163-e479e7831378, infoPort=35831, infoSecurePort=0, ipcPort=36947, storageInfo=lv=-57;cid=testClusterID;nsid=750105637;c=1676671295770), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:36,241 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xffa6501cebec6e6d: Processing first storage report for DS-8cf62b33-5d7d-41a5-9683-e3d8ce49328a from datanode 5730eb43-9d7d-45de-8163-e479e7831378 2023-02-17 22:01:36,241 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xffa6501cebec6e6d: from storage DS-8cf62b33-5d7d-41a5-9683-e3d8ce49328a node DatanodeRegistration(127.0.0.1:41197, datanodeUuid=5730eb43-9d7d-45de-8163-e479e7831378, infoPort=35831, infoSecurePort=0, ipcPort=36947, storageInfo=lv=-57;cid=testClusterID;nsid=750105637;c=1676671295770), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:36,257 INFO [Listener at localhost/36947] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36809 2023-02-17 22:01:36,265 WARN [Listener at localhost/40263] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:36,364 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x36ea44162da54636: Processing first storage report for DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46 from datanode cf6b6838-e1d9-45b9-a14b-5ece8c800fa6 2023-02-17 22:01:36,364 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x36ea44162da54636: from storage DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46 node DatanodeRegistration(127.0.0.1:42081, datanodeUuid=cf6b6838-e1d9-45b9-a14b-5ece8c800fa6, infoPort=43751, infoSecurePort=0, ipcPort=40263, storageInfo=lv=-57;cid=testClusterID;nsid=750105637;c=1676671295770), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 22:01:36,364 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x36ea44162da54636: Processing first storage report for DS-6c5987b8-e62e-419a-9d79-6d27d1678ace from datanode cf6b6838-e1d9-45b9-a14b-5ece8c800fa6 2023-02-17 22:01:36,364 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x36ea44162da54636: from storage DS-6c5987b8-e62e-419a-9d79-6d27d1678ace node DatanodeRegistration(127.0.0.1:42081, datanodeUuid=cf6b6838-e1d9-45b9-a14b-5ece8c800fa6, infoPort=43751, infoSecurePort=0, ipcPort=40263, storageInfo=lv=-57;cid=testClusterID;nsid=750105637;c=1676671295770), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:36,372 DEBUG [Listener at localhost/40263] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4 2023-02-17 22:01:36,374 INFO [Listener at localhost/40263] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/zookeeper_0, clientPort=49514, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:01:36,375 INFO [Listener at localhost/40263] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49514 2023-02-17 22:01:36,375 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,376 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,386 INFO [Listener at localhost/40263] util.FSUtils(479): Created version file at hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba with version=8 2023-02-17 22:01:36,386 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,387 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,388 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/hbase-staging 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:36,390 INFO [Listener at localhost/40263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:36,391 INFO [Listener at localhost/40263] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34179 2023-02-17 22:01:36,391 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,392 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,393 INFO [Listener at localhost/40263] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34179 connecting to ZooKeeper ensemble=127.0.0.1:49514 2023-02-17 22:01:36,402 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:341790x0, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:36,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34179-0x100644e83640000 connected 2023-02-17 22:01:36,428 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:36,429 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:36,429 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:36,429 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34179 2023-02-17 22:01:36,429 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34179 2023-02-17 22:01:36,430 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34179 2023-02-17 22:01:36,430 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34179 2023-02-17 22:01:36,430 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34179 2023-02-17 22:01:36,430 INFO [Listener at localhost/40263] master.HMaster(444): hbase.rootdir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba, hbase.cluster.distributed=false 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:36,443 INFO [Listener at localhost/40263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:36,444 INFO [Listener at localhost/40263] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37679 2023-02-17 22:01:36,444 INFO [Listener at localhost/40263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:36,446 DEBUG [Listener at localhost/40263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:36,447 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,447 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,448 INFO [Listener at localhost/40263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37679 connecting to ZooKeeper ensemble=127.0.0.1:49514 2023-02-17 22:01:36,452 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:376790x0, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:36,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37679-0x100644e83640001 connected 2023-02-17 22:01:36,453 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:36,454 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:36,454 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:36,454 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37679 2023-02-17 22:01:36,455 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37679 2023-02-17 22:01:36,455 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37679 2023-02-17 22:01:36,455 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37679 2023-02-17 22:01:36,455 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37679 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:36,466 INFO [Listener at localhost/40263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:36,467 INFO [Listener at localhost/40263] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43087 2023-02-17 22:01:36,467 INFO [Listener at localhost/40263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:36,468 DEBUG [Listener at localhost/40263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:36,468 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,469 INFO [Listener at localhost/40263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,469 INFO [Listener at localhost/40263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43087 connecting to ZooKeeper ensemble=127.0.0.1:49514 2023-02-17 22:01:36,473 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:430870x0, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:36,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43087-0x100644e83640002 connected 2023-02-17 22:01:36,474 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:36,474 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:36,475 DEBUG [Listener at localhost/40263] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:36,475 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43087 2023-02-17 22:01:36,475 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43087 2023-02-17 22:01:36,475 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43087 2023-02-17 22:01:36,476 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43087 2023-02-17 22:01:36,476 DEBUG [Listener at localhost/40263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43087 2023-02-17 22:01:36,477 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,478 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:36,479 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,480 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:36,480 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:36,480 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:36,480 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,481 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:36,482 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,34179,1676671296389 from backup master directory 2023-02-17 22:01:36,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:36,485 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,485 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:36,485 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:36,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,494 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/hbase.id with ID: bdb45f45-b422-49a2-b037-ae6a179b5343 2023-02-17 22:01:36,501 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:36,504 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,509 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x54525856 to 127.0.0.1:49514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:36,513 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4981d509, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:36,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:36,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:01:36,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:36,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store-tmp 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:36,520 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:36,520 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:36,520 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/WALs/jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,522 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34179%2C1676671296389, suffix=, logDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/WALs/jenkins-hbase9.apache.org,34179,1676671296389, archiveDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:36,536 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK] 2023-02-17 22:01:36,536 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK] 2023-02-17 22:01:36,538 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/WALs/jenkins-hbase9.apache.org,34179,1676671296389/jenkins-hbase9.apache.org%2C34179%2C1676671296389.1676671296522 2023-02-17 22:01:36,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK], DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK]] 2023-02-17 22:01:36,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:36,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:36,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:36,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:36,539 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:36,540 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:36,540 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:36,541 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:36,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:36,543 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:36,544 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:36,545 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74023179, jitterRate=0.10303132236003876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:36,545 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:36,545 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:36,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:36,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:36,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:36,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 22:01:36,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 22:01:36,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:36,547 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:36,548 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:36,559 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:36,559 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:36,560 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:36,560 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:36,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:36,562 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,563 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:36,563 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:36,564 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:36,566 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:36,566 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:36,566 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:36,566 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,566 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,34179,1676671296389, sessionid=0x100644e83640000, setting cluster-up flag (Was=false) 2023-02-17 22:01:36,571 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,579 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:36,580 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,582 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,587 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:36,588 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:36,588 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.hbase-snapshot/.tmp 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:36,590 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671326592 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:36,592 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:36,592 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:36,593 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:36,593 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:36,593 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:36,593 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:36,593 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:36,594 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671296593,5,FailOnTimeoutGroup] 2023-02-17 22:01:36,594 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671296594,5,FailOnTimeoutGroup] 2023-02-17 22:01:36,594 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,594 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:36,594 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,594 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,600 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:36,600 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:36,600 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba 2023-02-17 22:01:36,605 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:36,606 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:36,607 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/info 2023-02-17 22:01:36,607 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:36,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:36,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:36,609 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:36,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:36,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/table 2023-02-17 22:01:36,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:36,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,612 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740 2023-02-17 22:01:36,612 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740 2023-02-17 22:01:36,614 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:36,615 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:36,616 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:36,617 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71428553, jitterRate=0.06436838209629059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:36,617 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:36,617 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:36,617 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:36,617 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:36,617 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:36,617 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:36,617 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:36,617 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:36,618 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:36,618 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:36,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:36,619 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:36,621 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:36,678 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(952): ClusterId : bdb45f45-b422-49a2-b037-ae6a179b5343 2023-02-17 22:01:36,678 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(952): ClusterId : bdb45f45-b422-49a2-b037-ae6a179b5343 2023-02-17 22:01:36,678 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:36,678 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:36,680 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:36,680 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:36,680 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:36,680 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:36,683 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:36,684 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:36,685 DEBUG [RS:0;jenkins-hbase9:37679] zookeeper.ReadOnlyZKClient(139): Connect 0x6e6cf0da to 127.0.0.1:49514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:36,685 DEBUG [RS:1;jenkins-hbase9:43087] zookeeper.ReadOnlyZKClient(139): Connect 0x79ca23f1 to 127.0.0.1:49514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:36,692 DEBUG [RS:0;jenkins-hbase9:37679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60ab0367, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:36,692 DEBUG [RS:0;jenkins-hbase9:37679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64949baa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:36,692 DEBUG [RS:1;jenkins-hbase9:43087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@770dd2b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:36,692 DEBUG [RS:1;jenkins-hbase9:43087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73324881, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:36,701 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:37679 2023-02-17 22:01:36,701 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:43087 2023-02-17 22:01:36,701 INFO [RS:0;jenkins-hbase9:37679] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:36,701 INFO [RS:0;jenkins-hbase9:37679] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:36,701 INFO [RS:1;jenkins-hbase9:43087] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:36,701 INFO [RS:1;jenkins-hbase9:43087] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:36,701 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:36,701 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:36,701 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,34179,1676671296389 with isa=jenkins-hbase9.apache.org/172.31.2.10:43087, startcode=1676671296465 2023-02-17 22:01:36,701 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,34179,1676671296389 with isa=jenkins-hbase9.apache.org/172.31.2.10:37679, startcode=1676671296442 2023-02-17 22:01:36,701 DEBUG [RS:0;jenkins-hbase9:37679] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:36,701 DEBUG [RS:1;jenkins-hbase9:43087] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:36,703 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42931, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:36,703 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60091, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:36,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34179] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,705 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba 2023-02-17 22:01:36,705 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba 2023-02-17 22:01:36,705 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38957 2023-02-17 22:01:36,705 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38957 2023-02-17 22:01:36,705 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:36,705 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:36,708 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:36,712 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43087,1676671296465] 2023-02-17 22:01:36,712 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37679,1676671296442] 2023-02-17 22:01:36,712 DEBUG [RS:0;jenkins-hbase9:37679] zookeeper.ZKUtil(162): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,712 WARN [RS:0;jenkins-hbase9:37679] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:36,712 INFO [RS:0;jenkins-hbase9:37679] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:36,712 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,715 DEBUG [RS:1;jenkins-hbase9:43087] zookeeper.ZKUtil(162): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,715 WARN [RS:1;jenkins-hbase9:43087] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:36,716 INFO [RS:1;jenkins-hbase9:43087] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:36,716 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,726 DEBUG [RS:0;jenkins-hbase9:37679] zookeeper.ZKUtil(162): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,727 DEBUG [RS:0;jenkins-hbase9:37679] zookeeper.ZKUtil(162): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,727 DEBUG [RS:1;jenkins-hbase9:43087] zookeeper.ZKUtil(162): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,727 DEBUG [RS:1;jenkins-hbase9:43087] zookeeper.ZKUtil(162): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,728 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:36,728 INFO [RS:0;jenkins-hbase9:37679] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:36,729 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:36,729 INFO [RS:1;jenkins-hbase9:43087] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:36,729 INFO [RS:0;jenkins-hbase9:37679] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:36,731 INFO [RS:0;jenkins-hbase9:37679] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:36,731 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,743 INFO [RS:1;jenkins-hbase9:43087] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:36,744 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:36,745 INFO [RS:1;jenkins-hbase9:43087] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:36,745 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,750 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:36,750 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,752 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,752 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,752 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:36,752 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:36,753 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:0;jenkins-hbase9:37679] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,753 DEBUG [RS:1;jenkins-hbase9:43087] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:36,754 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,754 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,755 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,755 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,755 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,755 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,767 INFO [RS:0;jenkins-hbase9:37679] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:36,767 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37679,1676671296442-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,768 INFO [RS:1;jenkins-hbase9:43087] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:36,768 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43087,1676671296465-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:36,772 DEBUG [jenkins-hbase9:34179] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:36,772 DEBUG [jenkins-hbase9:34179] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:36,773 DEBUG [jenkins-hbase9:34179] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:36,774 DEBUG [jenkins-hbase9:34179] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:36,774 DEBUG [jenkins-hbase9:34179] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:36,774 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37679,1676671296442, state=OPENING 2023-02-17 22:01:36,775 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:36,777 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:36,777 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:36,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37679,1676671296442}] 2023-02-17 22:01:36,791 INFO [RS:1;jenkins-hbase9:43087] regionserver.Replication(203): jenkins-hbase9.apache.org,43087,1676671296465 started 2023-02-17 22:01:36,791 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,43087,1676671296465, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43087, sessionid=0x100644e83640002 2023-02-17 22:01:36,791 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:36,791 DEBUG [RS:1;jenkins-hbase9:43087] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43087,1676671296465' 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:36,792 INFO [RS:0;jenkins-hbase9:37679] regionserver.Replication(203): jenkins-hbase9.apache.org,37679,1676671296442 started 2023-02-17 22:01:36,792 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,37679,1676671296442, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37679, sessionid=0x100644e83640001 2023-02-17 22:01:36,792 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:36,792 DEBUG [RS:0;jenkins-hbase9:37679] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,792 DEBUG [RS:0;jenkins-hbase9:37679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37679,1676671296442' 2023-02-17 22:01:36,792 DEBUG [RS:0;jenkins-hbase9:37679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43087,1676671296465' 2023-02-17 22:01:36,792 DEBUG [RS:1;jenkins-hbase9:43087] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:36,793 DEBUG [RS:1;jenkins-hbase9:43087] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37679,1676671296442' 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:36,793 DEBUG [RS:1;jenkins-hbase9:43087] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:36,793 INFO [RS:1;jenkins-hbase9:43087] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:36,793 INFO [RS:1;jenkins-hbase9:43087] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:36,793 DEBUG [RS:0;jenkins-hbase9:37679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:36,794 DEBUG [RS:0;jenkins-hbase9:37679] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:36,794 INFO [RS:0;jenkins-hbase9:37679] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:36,794 INFO [RS:0;jenkins-hbase9:37679] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:36,940 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:36,941 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:36,942 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:36,946 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:36,946 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:36,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37679%2C1676671296442.meta, suffix=.meta, logDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,37679,1676671296442, archiveDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/oldWALs, maxLogs=32 2023-02-17 22:01:36,962 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK] 2023-02-17 22:01:36,962 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK] 2023-02-17 22:01:36,963 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,37679,1676671296442/jenkins-hbase9.apache.org%2C37679%2C1676671296442.meta.1676671296948.meta 2023-02-17 22:01:36,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK], DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK]] 2023-02-17 22:01:36,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:36,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:36,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:36,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:36,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:36,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:36,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:36,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:36,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:36,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/info 2023-02-17 22:01:36,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/info 2023-02-17 22:01:36,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:36,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:36,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:36,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:36,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:36,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:36,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/table 2023-02-17 22:01:36,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/table 2023-02-17 22:01:36,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:36,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:36,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740 2023-02-17 22:01:36,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740 2023-02-17 22:01:36,975 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:36,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:36,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61853662, jitterRate=-0.07830861210823059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:36,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:36,977 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671296940 2023-02-17 22:01:36,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:36,982 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:36,982 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37679,1676671296442, state=OPEN 2023-02-17 22:01:36,983 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:36,983 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:36,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:36,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37679,1676671296442 in 206 msec 2023-02-17 22:01:36,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:36,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-17 22:01:36,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-17 22:01:36,987 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671296987, completionTime=-1 2023-02-17 22:01:36,988 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:36,988 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:36,990 DEBUG [hconnection-0x42fa1f1d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:36,992 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59190, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:36,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:36,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671356994 2023-02-17 22:01:36,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671416994 2023-02-17 22:01:36,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-17 22:01:37,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34179,1676671296389-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:37,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34179,1676671296389-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:37,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34179,1676671296389-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:37,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:34179, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:37,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:37,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:37,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:37,003 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:37,003 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:37,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:37,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:37,005 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,006 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f empty. 2023-02-17 22:01:37,006 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,006 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:37,014 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:37,015 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 82302be0ef002172a70d49b986e8e13f, NAME => 'hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp 2023-02-17 22:01:37,020 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:37,020 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 82302be0ef002172a70d49b986e8e13f, disabling compactions & flushes 2023-02-17 22:01:37,020 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,021 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,021 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. after waiting 0 ms 2023-02-17 22:01:37,021 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,021 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,021 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 82302be0ef002172a70d49b986e8e13f: 2023-02-17 22:01:37,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:37,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671297023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671297023"}]},"ts":"1676671297023"} 2023-02-17 22:01:37,025 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:37,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:37,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671297026"}]},"ts":"1676671297026"} 2023-02-17 22:01:37,027 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:37,030 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:37,031 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:37,031 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:37,031 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:37,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=82302be0ef002172a70d49b986e8e13f, ASSIGN}] 2023-02-17 22:01:37,033 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=82302be0ef002172a70d49b986e8e13f, ASSIGN 2023-02-17 22:01:37,034 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=82302be0ef002172a70d49b986e8e13f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43087,1676671296465; forceNewPlan=false, retain=false 2023-02-17 22:01:37,184 INFO [jenkins-hbase9:34179] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:37,184 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=82302be0ef002172a70d49b986e8e13f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:37,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671297184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671297184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671297184"}]},"ts":"1676671297184"} 2023-02-17 22:01:37,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 82302be0ef002172a70d49b986e8e13f, server=jenkins-hbase9.apache.org,43087,1676671296465}] 2023-02-17 22:01:37,338 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:37,338 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:37,339 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42752, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:37,342 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,344 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43087%2C1676671296465, suffix=, logDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,43087,1676671296465, archiveDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/oldWALs, maxLogs=32 2023-02-17 22:01:37,357 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK] 2023-02-17 22:01:37,357 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK] 2023-02-17 22:01:37,359 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,43087,1676671296465/jenkins-hbase9.apache.org%2C43087%2C1676671296465.1676671297344 2023-02-17 22:01:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK], DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK]] 2023-02-17 22:01:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 82302be0ef002172a70d49b986e8e13f, NAME => 'hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,363 INFO [StoreOpener-82302be0ef002172a70d49b986e8e13f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,364 DEBUG [StoreOpener-82302be0ef002172a70d49b986e8e13f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/info 2023-02-17 22:01:37,364 DEBUG [StoreOpener-82302be0ef002172a70d49b986e8e13f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/info 2023-02-17 22:01:37,364 INFO [StoreOpener-82302be0ef002172a70d49b986e8e13f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82302be0ef002172a70d49b986e8e13f columnFamilyName info 2023-02-17 22:01:37,364 INFO [StoreOpener-82302be0ef002172a70d49b986e8e13f-1] regionserver.HStore(310): Store=82302be0ef002172a70d49b986e8e13f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:37,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:37,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:37,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 82302be0ef002172a70d49b986e8e13f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63351056, jitterRate=-0.05599570274353027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:37,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 82302be0ef002172a70d49b986e8e13f: 2023-02-17 22:01:37,369 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f., pid=6, masterSystemTime=1676671297338 2023-02-17 22:01:37,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,373 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:37,373 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=82302be0ef002172a70d49b986e8e13f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:37,373 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671297373"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671297373"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671297373"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671297373"}]},"ts":"1676671297373"} 2023-02-17 22:01:37,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:37,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 82302be0ef002172a70d49b986e8e13f, server=jenkins-hbase9.apache.org,43087,1676671296465 in 188 msec 2023-02-17 22:01:37,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:37,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=82302be0ef002172a70d49b986e8e13f, ASSIGN in 345 msec 2023-02-17 22:01:37,378 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:37,378 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671297378"}]},"ts":"1676671297378"} 2023-02-17 22:01:37,379 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:37,381 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:37,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-17 22:01:37,404 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:37,405 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:37,405 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:37,407 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:37,408 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:37,410 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:37,417 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:37,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-17 22:01:37,431 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:37,436 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:37,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-17 22:01:37,446 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:37,448 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:37,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.963sec 2023-02-17 22:01:37,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:37,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:37,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:37,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34179,1676671296389-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:37,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34179,1676671296389-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:37,450 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:37,479 DEBUG [Listener at localhost/40263] zookeeper.ReadOnlyZKClient(139): Connect 0x3a36ba76 to 127.0.0.1:49514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:37,487 DEBUG [Listener at localhost/40263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d42b1f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:37,488 DEBUG [hconnection-0x2bc46b05-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:37,490 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:37,491 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:37,491 DEBUG [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:37,493 DEBUG [Listener at localhost/40263] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:37,496 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56178, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:37,496 INFO [Listener at localhost/40263] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-17 22:01:37,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceSingleRegion 2023-02-17 22:01:37,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:37,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.2.10:56178 deadline: 1676671357497, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-17 22:01:37,497 INFO [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-17 22:01:37,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:37,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:37,502 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:37,502 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-17 22:01:37,502 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:37,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:37,504 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,504 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 empty. 2023-02-17 22:01:37,504 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-17 22:01:37,512 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:37,513 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 980efed815f7727c97a6955be2b3cf89, NAME => 'testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp 2023-02-17 22:01:37,518 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:37,518 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 980efed815f7727c97a6955be2b3cf89, disabling compactions & flushes 2023-02-17 22:01:37,518 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,518 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,518 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. after waiting 0 ms 2023-02-17 22:01:37,518 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,518 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,518 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:37,520 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:37,520 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676671297520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671297520"}]},"ts":"1676671297520"} 2023-02-17 22:01:37,521 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:37,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:37,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671297522"}]},"ts":"1676671297522"} 2023-02-17 22:01:37,523 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-17 22:01:37,526 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:37,527 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:37,527 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:37,527 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:37,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, ASSIGN}] 2023-02-17 22:01:37,529 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, ASSIGN 2023-02-17 22:01:37,529 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43087,1676671296465; forceNewPlan=false, retain=false 2023-02-17 22:01:37,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:37,680 INFO [jenkins-hbase9:34179] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:37,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=980efed815f7727c97a6955be2b3cf89, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:37,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676671297680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671297680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671297680"}]},"ts":"1676671297680"} 2023-02-17 22:01:37,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 980efed815f7727c97a6955be2b3cf89, server=jenkins-hbase9.apache.org,43087,1676671296465}] 2023-02-17 22:01:37,795 INFO [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37679%2C1676671296442, suffix=, logDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,37679,1676671296442, archiveDir=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/oldWALs, maxLogs=32 2023-02-17 22:01:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:37,808 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK] 2023-02-17 22:01:37,808 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK] 2023-02-17 22:01:37,810 INFO [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/WALs/jenkins-hbase9.apache.org,37679,1676671296442/jenkins-hbase9.apache.org%2C37679%2C1676671296442.1676671297796 2023-02-17 22:01:37,810 DEBUG [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42081,DS-ec5eaccd-1245-4ca4-90f9-f60e6f4e3e46,DISK], DatanodeInfoWithStorage[127.0.0.1:41197,DS-8c2f28b0-8ded-499f-ba68-4873b2c0b200,DISK]] 2023-02-17 22:01:37,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 980efed815f7727c97a6955be2b3cf89, NAME => 'testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,837 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,839 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1 2023-02-17 22:01:37,839 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1 2023-02-17 22:01:37,839 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 980efed815f7727c97a6955be2b3cf89 columnFamilyName f1 2023-02-17 22:01:37,839 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(310): Store=980efed815f7727c97a6955be2b3cf89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:37,839 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,840 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2 2023-02-17 22:01:37,840 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2 2023-02-17 22:01:37,841 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 980efed815f7727c97a6955be2b3cf89 columnFamilyName f2 2023-02-17 22:01:37,841 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(310): Store=980efed815f7727c97a6955be2b3cf89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:37,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:37,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:37,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:37,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 980efed815f7727c97a6955be2b3cf89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63949194, jitterRate=-0.047082751989364624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:37,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:37,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89., pid=12, masterSystemTime=1676671297833 2023-02-17 22:01:37,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:37,848 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=980efed815f7727c97a6955be2b3cf89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:37,848 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676671297848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671297848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671297848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671297848"}]},"ts":"1676671297848"} 2023-02-17 22:01:37,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 22:01:37,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 980efed815f7727c97a6955be2b3cf89, server=jenkins-hbase9.apache.org,43087,1676671296465 in 168 msec 2023-02-17 22:01:37,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 22:01:37,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, ASSIGN in 324 msec 2023-02-17 22:01:37,853 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:37,853 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671297853"}]},"ts":"1676671297853"} 2023-02-17 22:01:37,854 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-17 22:01:37,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:37,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 356 msec 2023-02-17 22:01:38,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:38,107 INFO [Listener at localhost/40263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-17 22:01:38,107 DEBUG [Listener at localhost/40263] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-17 22:01:38,107 INFO [Listener at localhost/40263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:38,109 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-17 22:01:38,109 INFO [Listener at localhost/40263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:38,109 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-17 22:01:38,109 INFO [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:38,123 DEBUG [hconnection-0x2bc46b05-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:38,134 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42764, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:38,141 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,234 INFO [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:38,234 INFO [Listener at localhost/40263] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:38,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 22:01:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671298235 (current time:1676671298235). 2023-02-17 22:01:38,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:38,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] zookeeper.ReadOnlyZKClient(139): Connect 0x5501ff1a to 127.0.0.1:49514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:38,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e6e4081, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:38,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:38,242 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59208, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5501ff1a to 127.0.0.1:49514 2023-02-17 22:01:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 22:01:38,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 22:01:38,246 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 22:01:38,247 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676671898247 2023-02-17 22:01:38,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 22:01:38,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,248 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:38,249 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 22:01:38,249 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:38,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 22:01:38,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-17 22:01:38,251 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 22:01:38,251 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676671898251 2023-02-17 22:01:38,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,260 INFO [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-17 22:01:38,260 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:38,261 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-17 22:01:38,261 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 22:01:38,261 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,261 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,262 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:38,262 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:38,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:38,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:38,262 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,263 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,263 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-17 22:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-17 22:01:38,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-17 22:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,266 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-17 22:01:38,266 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:38,267 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 22:01:38,267 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 22:01:38,267 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43087,1676671296465' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 22:01:38,267 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-17 22:01:38,267 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:38,268 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 22:01:38,268 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 22:01:38,268 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37679,1676671296442' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 22:01:38,270 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,270 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:38,271 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,271 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,271 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:38,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:38,271 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,271 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:38,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:38,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:38,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43087,1676671296465' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-17 22:01:38,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12b41929[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:38,272 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 22:01:38,272 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,273 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 22:01:38,274 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 22:01:38,274 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,274 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:38,274 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 22:01:38,274 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,37679,1676671296442' in zk 2023-02-17 22:01:38,274 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 22:01:38,274 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:38,274 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,274 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. started... 2023-02-17 22:01:38,274 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 980efed815f7727c97a6955be2b3cf89 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 22:01:38,275 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 22:01:38,275 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:38,275 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 22:01:38,287 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f1/ad9985cc2c1d4ea59cb73e5f953963cb 2023-02-17 22:01:38,302 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f2/f4f667a431734b9cabab9421f4992d84 2023-02-17 22:01:38,305 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f1/ad9985cc2c1d4ea59cb73e5f953963cb as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/ad9985cc2c1d4ea59cb73e5f953963cb 2023-02-17 22:01:38,309 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/ad9985cc2c1d4ea59cb73e5f953963cb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:38,309 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f2/f4f667a431734b9cabab9421f4992d84 as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/f4f667a431734b9cabab9421f4992d84 2023-02-17 22:01:38,312 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/f4f667a431734b9cabab9421f4992d84, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:38,313 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 980efed815f7727c97a6955be2b3cf89 in 39ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:38,313 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/ad9985cc2c1d4ea59cb73e5f953963cb] hfiles 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/ad9985cc2c1d4ea59cb73e5f953963cb for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/f4f667a431734b9cabab9421f4992d84] hfiles 2023-02-17 22:01:38,314 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/f4f667a431734b9cabab9421f4992d84 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,319 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. completed. 2023-02-17 22:01:38,319 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,319 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 22:01:38,319 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 22:01:38,319 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,319 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 22:01:38,319 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,43087,1676671296465' in zk 2023-02-17 22:01:38,322 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,322 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 22:01:38,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:38,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:38,322 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:38,322 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 22:01:38,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:38,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,43087,1676671296465': 2023-02-17 22:01:38,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43087,1676671296465' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:38,325 INFO [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-17 22:01:38,325 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:38,325 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:38,325 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,325 INFO [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:38,326 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,326 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:38,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:38,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:38,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:38,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,327 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,328 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:38,330 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,331 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:38,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:38,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:38,338 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:38,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:38,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:38,338 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,339 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,339 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,339 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,339 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,339 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,339 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:38,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:38,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:38,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,349 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:38,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-17 22:01:38,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:38,351 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:38,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,364 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:38,364 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-17 22:01:38,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-17 22:01:38,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,377 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676671298247Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676671298338 (+91 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676671298338Writing data manifest for testWithMockedMapReduceSingleRegion at 1676671298348 (+10 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676671298357 (+9 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676671298376 (+19 ms) 2023-02-17 22:01:38,379 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 22:01:38,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 131 msec 2023-02-17 22:01:38,551 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:38,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-17 22:01:38,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:38,553 INFO [Listener at localhost/40263] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:38,557 INFO [Listener at localhost/40263] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:38,561 INFO [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:38,587 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,740 INFO [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:38,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,748 INFO [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-17 22:01:38,748 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:38,749 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-17 22:01:38,749 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 22:01:38,749 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,749 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,752 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:38,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:38,752 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:38,752 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,753 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,753 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:38,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,754 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-17 22:01:38,754 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,755 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 22:01:38,755 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 22:01:38,755 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37679,1676671296442' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 22:01:38,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,756 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-17 22:01:38,756 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:38,756 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 22:01:38,757 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 22:01:38,757 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:38,757 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,757 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. started... 2023-02-17 22:01:38,757 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 980efed815f7727c97a6955be2b3cf89 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 22:01:38,759 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,759 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,759 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:38,779 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f1/02b78d32d35f42ca829d93b4b202c2d1 2023-02-17 22:01:38,803 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f2/40a1037f51644a90893f62f854a8d237 2023-02-17 22:01:38,807 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f1/02b78d32d35f42ca829d93b4b202c2d1 as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/02b78d32d35f42ca829d93b4b202c2d1 2023-02-17 22:01:38,810 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/02b78d32d35f42ca829d93b4b202c2d1, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:38,811 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/.tmp/f2/40a1037f51644a90893f62f854a8d237 as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/40a1037f51644a90893f62f854a8d237 2023-02-17 22:01:38,815 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/40a1037f51644a90893f62f854a8d237, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:38,816 INFO [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 980efed815f7727c97a6955be2b3cf89 in 59ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:38,817 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:38,817 DEBUG [rs(jenkins-hbase9.apache.org,43087,1676671296465)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,817 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 22:01:38,817 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 22:01:38,818 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,818 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 22:01:38,818 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43087,1676671296465' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 22:01:38,820 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,820 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:38,820 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,820 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:38,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43087,1676671296465' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-17 22:01:38,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@168b8fa7[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:38,822 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 22:01:38,822 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,823 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,823 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,823 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 22:01:38,824 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 22:01:38,824 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,824 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,824 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,37679,1676671296442' in zk 2023-02-17 22:01:38,824 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 22:01:38,824 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 22:01:38,824 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,43087,1676671296465' in zk 2023-02-17 22:01:38,825 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:38,825 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 22:01:38,825 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 22:01:38,825 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:38,825 DEBUG [member: 'jenkins-hbase9.apache.org,43087,1676671296465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 22:01:38,825 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:38,826 DEBUG [member: 'jenkins-hbase9.apache.org,37679,1676671296442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 22:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,43087,1676671296465': 2023-02-17 22:01:38,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43087,1676671296465' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:38,828 INFO [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-17 22:01:38,828 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:38,828 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:38,828 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,828 INFO [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:38,829 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,829 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:38,830 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:38,829 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:38,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:38,830 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:38,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,831 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,834 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:38,835 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:38,838 DEBUG [(jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:38,838 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-17 22:01:38,838 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:38,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:38,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:38,838 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:38,839 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:38,839 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,839 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,939 DEBUG [Listener at localhost/40263] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:38,944 INFO [Listener at localhost/40263] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676671298235 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:38,945 DEBUG [Listener at localhost/40263] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce/data/default/testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,945 INFO [Listener at localhost/40263] snapshot.RestoreSnapshotHelper(239): region to add: 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:38,945 INFO [Listener at localhost/40263] snapshot.RestoreSnapshotHelper(585): clone region=980efed815f7727c97a6955be2b3cf89 as 980efed815f7727c97a6955be2b3cf89 in snapshot testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,946 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 980efed815f7727c97a6955be2b3cf89, NAME => 'testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce 2023-02-17 22:01:38,953 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:38,953 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ad9985cc2c1d4ea59cb73e5f953963cb from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,955 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4f667a431734b9cabab9421f4992d84 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:38,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 980efed815f7727c97a6955be2b3cf89, disabling compactions & flushes 2023-02-17 22:01:38,957 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. after waiting 0 ms 2023-02-17 22:01:38,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,957 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:38,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:38,957 INFO [Listener at localhost/40263] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676671298235 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:38,957 DEBUG [Listener at localhost/40263] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce 2023-02-17 22:01:38,957 DEBUG [Listener at localhost/40263] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce 2023-02-17 22:01:38,958 DEBUG [Listener at localhost/40263] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:38,958 DEBUG [Listener at localhost/40263] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:38,958 DEBUG [Listener at localhost/40263] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-17 22:01:38,959 DEBUG [Listener at localhost/40263] util.CommonFSUtils(699): |----------980efed815f7727c97a6955be2b3cf89/ 2023-02-17 22:01:38,959 DEBUG [Listener at localhost/40263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:38,959 DEBUG [Listener at localhost/40263] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:38,959 DEBUG [Listener at localhost/40263] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=980efed815f7727c97a6955be2b3cf89-ad9985cc2c1d4ea59cb73e5f953963cb 2023-02-17 22:01:38,959 DEBUG [Listener at localhost/40263] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:38,960 DEBUG [Listener at localhost/40263] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=980efed815f7727c97a6955be2b3cf89-f4f667a431734b9cabab9421f4992d84 2023-02-17 22:01:38,963 INFO [Listener at localhost/40263] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 22:01:38,967 DEBUG [Listener at localhost/40263] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:38,967 INFO [Listener at localhost/40263] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:38,968 DEBUG [Listener at localhost/40263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:38,969 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:38,970 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1 2023-02-17 22:01:38,970 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 980efed815f7727c97a6955be2b3cf89 columnFamilyName f1 2023-02-17 22:01:38,974 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(539): loaded hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/testWithMockedMapReduceSingleRegion=980efed815f7727c97a6955be2b3cf89-ad9985cc2c1d4ea59cb73e5f953963cb 2023-02-17 22:01:38,974 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(310): Store=980efed815f7727c97a6955be2b3cf89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:38,974 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:38,975 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2 2023-02-17 22:01:38,976 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 980efed815f7727c97a6955be2b3cf89 columnFamilyName f2 2023-02-17 22:01:38,985 DEBUG [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(539): loaded hdfs://localhost:38957/user/jenkins/test-data/5f3ee965-5867-c648-129b-5221dc5e7a7f/testWithMockedMapReduceSingleRegion/dfec9a06-f468-4a70-aa60-860fa3becfce/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/testWithMockedMapReduceSingleRegion=980efed815f7727c97a6955be2b3cf89-f4f667a431734b9cabab9421f4992d84 2023-02-17 22:01:38,985 INFO [StoreOpener-980efed815f7727c97a6955be2b3cf89-1] regionserver.HStore(310): Store=980efed815f7727c97a6955be2b3cf89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:38,986 DEBUG [Listener at localhost/40263] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:38,986 INFO [Listener at localhost/40263] regionserver.HRegion(1071): Opened 980efed815f7727c97a6955be2b3cf89; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64216364, jitterRate=-0.043101608753204346}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:38,986 DEBUG [Listener at localhost/40263] regionserver.HRegion(964): Region open journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:39,039 DEBUG [Listener at localhost/40263] regionserver.HRegion(1603): Closing 980efed815f7727c97a6955be2b3cf89, disabling compactions & flushes 2023-02-17 22:01:39,039 INFO [Listener at localhost/40263] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,039 DEBUG [Listener at localhost/40263] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,039 DEBUG [Listener at localhost/40263] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. after waiting 0 ms 2023-02-17 22:01:39,039 DEBUG [Listener at localhost/40263] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,041 INFO [Listener at localhost/40263] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,041 DEBUG [Listener at localhost/40263] regionserver.HRegion(1557): Region close journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:39,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-17 22:01:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,050 INFO [Listener at localhost/40263] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,051 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:39,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671299055"}]},"ts":"1676671299055"} 2023-02-17 22:01:39,056 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-17 22:01:39,058 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-17 22:01:39,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, UNASSIGN}] 2023-02-17 22:01:39,061 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, UNASSIGN 2023-02-17 22:01:39,061 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=980efed815f7727c97a6955be2b3cf89, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:39,062 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676671299061"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671299061"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671299061"}]},"ts":"1676671299061"} 2023-02-17 22:01:39,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 980efed815f7727c97a6955be2b3cf89, server=jenkins-hbase9.apache.org,43087,1676671296465}] 2023-02-17 22:01:39,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:39,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:39,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 980efed815f7727c97a6955be2b3cf89, disabling compactions & flushes 2023-02-17 22:01:39,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. after waiting 0 ms 2023-02-17 22:01:39,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:39,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89. 2023-02-17 22:01:39,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 980efed815f7727c97a6955be2b3cf89: 2023-02-17 22:01:39,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:39,221 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=980efed815f7727c97a6955be2b3cf89, regionState=CLOSED 2023-02-17 22:01:39,222 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676671299221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671299221"}]},"ts":"1676671299221"} 2023-02-17 22:01:39,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 22:01:39,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 980efed815f7727c97a6955be2b3cf89, server=jenkins-hbase9.apache.org,43087,1676671296465 in 160 msec 2023-02-17 22:01:39,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 22:01:39,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=980efed815f7727c97a6955be2b3cf89, UNASSIGN in 165 msec 2023-02-17 22:01:39,225 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671299225"}]},"ts":"1676671299225"} 2023-02-17 22:01:39,226 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-17 22:01:39,228 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-17 22:01:39,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 177 msec 2023-02-17 22:01:39,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:39,358 INFO [Listener at localhost/40263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-17 22:01:39,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,361 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,361 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:39,364 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:39,367 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1, FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2, FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/recovered.edits] 2023-02-17 22:01:39,369 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/02b78d32d35f42ca829d93b4b202c2d1 to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/archive/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/02b78d32d35f42ca829d93b4b202c2d1 2023-02-17 22:01:39,370 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/ad9985cc2c1d4ea59cb73e5f953963cb to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/archive/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f1/ad9985cc2c1d4ea59cb73e5f953963cb 2023-02-17 22:01:39,372 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/40a1037f51644a90893f62f854a8d237 to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/archive/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/40a1037f51644a90893f62f854a8d237 2023-02-17 22:01:39,373 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/f4f667a431734b9cabab9421f4992d84 to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/archive/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/f2/f4f667a431734b9cabab9421f4992d84 2023-02-17 22:01:39,376 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/recovered.edits/12.seqid to hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/archive/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89/recovered.edits/12.seqid 2023-02-17 22:01:39,376 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/.tmp/data/default/testWithMockedMapReduceSingleRegion/980efed815f7727c97a6955be2b3cf89 2023-02-17 22:01:39,376 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-17 22:01:39,378 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,379 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-17 22:01:39,380 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-17 22:01:39,381 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,381 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-17 22:01:39,381 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671299381"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:39,382 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 22:01:39,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 980efed815f7727c97a6955be2b3cf89, NAME => 'testWithMockedMapReduceSingleRegion,,1676671297499.980efed815f7727c97a6955be2b3cf89.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 22:01:39,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-17 22:01:39,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676671299382"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:39,384 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-17 22:01:39,385 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 22:01:39,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-17 22:01:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34179] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:39,464 INFO [Listener at localhost/40263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-17 22:01:39,464 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:39,464 INFO [Listener at localhost/40263] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:39,464 DEBUG [Listener at localhost/40263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a36ba76 to 127.0.0.1:49514 2023-02-17 22:01:39,464 DEBUG [Listener at localhost/40263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,464 DEBUG [Listener at localhost/40263] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:39,465 DEBUG [Listener at localhost/40263] util.JVMClusterUtil(257): Found active master hash=343797724, stopped=false 2023-02-17 22:01:39,465 INFO [Listener at localhost/40263] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:39,470 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:39,470 INFO [Listener at localhost/40263] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:39,470 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:39,473 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:39,470 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:39,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:39,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:39,473 DEBUG [Listener at localhost/40263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54525856 to 127.0.0.1:49514 2023-02-17 22:01:39,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:39,473 DEBUG [Listener at localhost/40263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,473 INFO [Listener at localhost/40263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37679,1676671296442' ***** 2023-02-17 22:01:39,473 INFO [Listener at localhost/40263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:39,474 INFO [Listener at localhost/40263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,43087,1676671296465' ***** 2023-02-17 22:01:39,474 INFO [Listener at localhost/40263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:39,474 INFO [RS:0;jenkins-hbase9:37679] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:39,474 INFO [RS:1;jenkins-hbase9:43087] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:39,474 INFO [RS:1;jenkins-hbase9:43087] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:39,474 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:39,474 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:39,474 INFO [RS:0;jenkins-hbase9:37679] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:39,474 INFO [RS:1;jenkins-hbase9:43087] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:39,475 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(3304): Received CLOSE for 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:39,475 INFO [RS:0;jenkins-hbase9:37679] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:39,475 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:39,475 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:39,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 82302be0ef002172a70d49b986e8e13f, disabling compactions & flushes 2023-02-17 22:01:39,475 DEBUG [RS:1;jenkins-hbase9:43087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79ca23f1 to 127.0.0.1:49514 2023-02-17 22:01:39,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:39,475 DEBUG [RS:0;jenkins-hbase9:37679] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e6cf0da to 127.0.0.1:49514 2023-02-17 22:01:39,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:39,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. after waiting 0 ms 2023-02-17 22:01:39,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:39,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 82302be0ef002172a70d49b986e8e13f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:39,475 DEBUG [RS:1;jenkins-hbase9:43087] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,477 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 22:01:39,477 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1479): Online Regions={82302be0ef002172a70d49b986e8e13f=hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f.} 2023-02-17 22:01:39,477 DEBUG [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1505): Waiting on 82302be0ef002172a70d49b986e8e13f 2023-02-17 22:01:39,476 DEBUG [RS:0;jenkins-hbase9:37679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,477 INFO [RS:0;jenkins-hbase9:37679] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:39,477 INFO [RS:0;jenkins-hbase9:37679] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:39,477 INFO [RS:0;jenkins-hbase9:37679] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:39,477 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:39,478 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 22:01:39,478 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 22:01:39,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:39,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:39,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:39,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:39,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:39,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-17 22:01:39,478 DEBUG [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 22:01:39,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/.tmp/info/4c75f0facff04490a46d2840c5959c1d 2023-02-17 22:01:39,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/.tmp/info/9c849ceaab874e12bea657a5de9a00b7 2023-02-17 22:01:39,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c75f0facff04490a46d2840c5959c1d 2023-02-17 22:01:39,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/.tmp/info/9c849ceaab874e12bea657a5de9a00b7 as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/info/9c849ceaab874e12bea657a5de9a00b7 2023-02-17 22:01:39,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/info/9c849ceaab874e12bea657a5de9a00b7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:39,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 82302be0ef002172a70d49b986e8e13f in 25ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:39,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/.tmp/rep_barrier/27da35510d3848e58f89cba17dda4b57 2023-02-17 22:01:39,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/namespace/82302be0ef002172a70d49b986e8e13f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:39,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:39,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 82302be0ef002172a70d49b986e8e13f: 2023-02-17 22:01:39,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671297002.82302be0ef002172a70d49b986e8e13f. 2023-02-17 22:01:39,522 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27da35510d3848e58f89cba17dda4b57 2023-02-17 22:01:39,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/.tmp/table/8374648a6afa45b59bee94d1b53b94b3 2023-02-17 22:01:39,541 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8374648a6afa45b59bee94d1b53b94b3 2023-02-17 22:01:39,542 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/.tmp/info/4c75f0facff04490a46d2840c5959c1d as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/info/4c75f0facff04490a46d2840c5959c1d 2023-02-17 22:01:39,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c75f0facff04490a46d2840c5959c1d 2023-02-17 22:01:39,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/info/4c75f0facff04490a46d2840c5959c1d, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 22:01:39,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/.tmp/rep_barrier/27da35510d3848e58f89cba17dda4b57 as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/rep_barrier/27da35510d3848e58f89cba17dda4b57 2023-02-17 22:01:39,549 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27da35510d3848e58f89cba17dda4b57 2023-02-17 22:01:39,549 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/rep_barrier/27da35510d3848e58f89cba17dda4b57, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 22:01:39,550 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/.tmp/table/8374648a6afa45b59bee94d1b53b94b3 as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/table/8374648a6afa45b59bee94d1b53b94b3 2023-02-17 22:01:39,554 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8374648a6afa45b59bee94d1b53b94b3 2023-02-17 22:01:39,554 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/table/8374648a6afa45b59bee94d1b53b94b3, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 22:01:39,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=21, compaction requested=false 2023-02-17 22:01:39,561 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 22:01:39,561 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:39,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:39,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:39,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:39,566 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:39,566 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:39,677 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,43087,1676671296465; all regions closed. 2023-02-17 22:01:39,678 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37679,1676671296442; all regions closed. 2023-02-17 22:01:39,682 DEBUG [RS:1;jenkins-hbase9:43087] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/oldWALs 2023-02-17 22:01:39,682 INFO [RS:1;jenkins-hbase9:43087] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43087%2C1676671296465:(num 1676671297344) 2023-02-17 22:01:39,682 DEBUG [RS:1;jenkins-hbase9:43087] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,683 INFO [RS:1;jenkins-hbase9:43087] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:39,683 INFO [RS:1;jenkins-hbase9:43087] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:39,683 INFO [RS:1;jenkins-hbase9:43087] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:39,683 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:39,683 INFO [RS:1;jenkins-hbase9:43087] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:39,683 INFO [RS:1;jenkins-hbase9:43087] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:39,684 INFO [RS:1;jenkins-hbase9:43087] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43087 2023-02-17 22:01:39,685 DEBUG [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/oldWALs 2023-02-17 22:01:39,685 INFO [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37679%2C1676671296442.meta:.meta(num 1676671296948) 2023-02-17 22:01:39,686 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:39,686 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:39,687 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:39,687 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43087,1676671296465 2023-02-17 22:01:39,687 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:39,688 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43087,1676671296465] 2023-02-17 22:01:39,688 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43087,1676671296465; numProcessing=1 2023-02-17 22:01:39,691 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43087,1676671296465 already deleted, retry=false 2023-02-17 22:01:39,691 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43087,1676671296465 expired; onlineServers=1 2023-02-17 22:01:39,692 DEBUG [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/oldWALs 2023-02-17 22:01:39,693 INFO [RS:0;jenkins-hbase9:37679] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37679%2C1676671296442:(num 1676671297796) 2023-02-17 22:01:39,693 DEBUG [RS:0;jenkins-hbase9:37679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,693 INFO [RS:0;jenkins-hbase9:37679] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:39,693 INFO [RS:0;jenkins-hbase9:37679] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:39,694 INFO [RS:0;jenkins-hbase9:37679] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37679 2023-02-17 22:01:39,694 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:39,789 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:39,789 INFO [RS:1;jenkins-hbase9:43087] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,43087,1676671296465; zookeeper connection closed. 2023-02-17 22:01:39,789 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3654e753 rejected from java.util.concurrent.ThreadPoolExecutor@326b6541[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:39,789 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:43087-0x100644e83640002, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:39,789 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@395d699f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@395d699f 2023-02-17 22:01:39,789 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57ab8732 rejected from java.util.concurrent.ThreadPoolExecutor@326b6541[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:39,791 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37679,1676671296442 2023-02-17 22:01:39,791 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:39,792 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47aa7e7 rejected from java.util.concurrent.ThreadPoolExecutor@4523b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:39,793 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37679,1676671296442] 2023-02-17 22:01:39,793 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37679,1676671296442; numProcessing=2 2023-02-17 22:01:39,801 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37679,1676671296442 already deleted, retry=false 2023-02-17 22:01:39,801 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37679,1676671296442 expired; onlineServers=0 2023-02-17 22:01:39,801 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,34179,1676671296389' ***** 2023-02-17 22:01:39,801 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:39,801 DEBUG [M:0;jenkins-hbase9:34179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1042798b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:39,802 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,34179,1676671296389 2023-02-17 22:01:39,802 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,34179,1676671296389; all regions closed. 2023-02-17 22:01:39,802 DEBUG [M:0;jenkins-hbase9:34179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:39,802 DEBUG [M:0;jenkins-hbase9:34179] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:39,802 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:39,802 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671296594] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671296594,5,FailOnTimeoutGroup] 2023-02-17 22:01:39,802 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671296593] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671296593,5,FailOnTimeoutGroup] 2023-02-17 22:01:39,802 DEBUG [M:0;jenkins-hbase9:34179] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:39,803 INFO [M:0;jenkins-hbase9:34179] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:39,803 INFO [M:0;jenkins-hbase9:34179] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:39,803 INFO [M:0;jenkins-hbase9:34179] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:39,803 DEBUG [M:0;jenkins-hbase9:34179] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:39,803 INFO [M:0;jenkins-hbase9:34179] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:39,803 ERROR [M:0;jenkins-hbase9:34179] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 22:01:39,804 INFO [M:0;jenkins-hbase9:34179] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:39,804 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:39,804 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:39,804 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:39,804 DEBUG [M:0;jenkins-hbase9:34179] zookeeper.ZKUtil(398): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:39,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:39,804 WARN [M:0;jenkins-hbase9:34179] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:39,804 INFO [M:0;jenkins-hbase9:34179] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:39,805 INFO [M:0;jenkins-hbase9:34179] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:39,805 DEBUG [M:0;jenkins-hbase9:34179] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:39,805 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:39,805 DEBUG [M:0;jenkins-hbase9:34179] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:39,805 DEBUG [M:0;jenkins-hbase9:34179] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:39,805 DEBUG [M:0;jenkins-hbase9:34179] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:39,805 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.14 KB heapSize=67.07 KB 2023-02-17 22:01:39,816 INFO [M:0;jenkins-hbase9:34179] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.14 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/97a30a4d70c141cfb18aa67d80114fed 2023-02-17 22:01:39,820 DEBUG [M:0;jenkins-hbase9:34179] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/97a30a4d70c141cfb18aa67d80114fed as hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/97a30a4d70c141cfb18aa67d80114fed 2023-02-17 22:01:39,824 INFO [M:0;jenkins-hbase9:34179] regionserver.HStore(1080): Added hdfs://localhost:38957/user/jenkins/test-data/26ec1ea9-839a-ca44-d606-3bf4c18da2ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/97a30a4d70c141cfb18aa67d80114fed, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 22:01:39,824 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegion(2947): Finished flush of dataSize ~56.14 KB/57485, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-17 22:01:39,825 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:39,825 DEBUG [M:0;jenkins-hbase9:34179] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:39,827 INFO [M:0;jenkins-hbase9:34179] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:39,827 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:39,828 INFO [M:0;jenkins-hbase9:34179] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34179 2023-02-17 22:01:39,831 DEBUG [M:0;jenkins-hbase9:34179] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,34179,1676671296389 already deleted, retry=false 2023-02-17 22:01:39,970 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:39,971 INFO [M:0;jenkins-hbase9:34179] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,34179,1676671296389; zookeeper connection closed. 2023-02-17 22:01:39,971 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d7c4a8a rejected from java.util.concurrent.ThreadPoolExecutor@2943dbfd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:39,972 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): master:34179-0x100644e83640000, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:39,972 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1280ba6c rejected from java.util.concurrent.ThreadPoolExecutor@2943dbfd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:40,071 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:40,071 INFO [RS:0;jenkins-hbase9:37679] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37679,1676671296442; zookeeper connection closed. 2023-02-17 22:01:40,071 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25dc16fc rejected from java.util.concurrent.ThreadPoolExecutor@4523b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:40,071 DEBUG [Listener at localhost/40263-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x100644e83640001, quorum=127.0.0.1:49514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:40,071 ERROR [Listener at localhost/40263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d392da5 rejected from java.util.concurrent.ThreadPoolExecutor@4523b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:40,074 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c8c0f3c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c8c0f3c 2023-02-17 22:01:40,075 INFO [Listener at localhost/40263] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:40,076 WARN [Listener at localhost/40263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:40,081 INFO [Listener at localhost/40263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:40,186 WARN [BP-790037978-172.31.2.10-1676671295770 heartbeating to localhost/127.0.0.1:38957] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:40,186 WARN [BP-790037978-172.31.2.10-1676671295770 heartbeating to localhost/127.0.0.1:38957] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-790037978-172.31.2.10-1676671295770 (Datanode Uuid cf6b6838-e1d9-45b9-a14b-5ece8c800fa6) service to localhost/127.0.0.1:38957 2023-02-17 22:01:40,187 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/dfs/data/data3/current/BP-790037978-172.31.2.10-1676671295770] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:40,187 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/dfs/data/data4/current/BP-790037978-172.31.2.10-1676671295770] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:40,189 WARN [Listener at localhost/40263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:40,192 INFO [Listener at localhost/40263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:40,295 WARN [BP-790037978-172.31.2.10-1676671295770 heartbeating to localhost/127.0.0.1:38957] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:40,295 WARN [BP-790037978-172.31.2.10-1676671295770 heartbeating to localhost/127.0.0.1:38957] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-790037978-172.31.2.10-1676671295770 (Datanode Uuid 5730eb43-9d7d-45de-8163-e479e7831378) service to localhost/127.0.0.1:38957 2023-02-17 22:01:40,296 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/dfs/data/data1/current/BP-790037978-172.31.2.10-1676671295770] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:40,296 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/cluster_1c4e7e9c-0c2c-9ecd-c5e2-62f02bb4809d/dfs/data/data2/current/BP-790037978-172.31.2.10-1676671295770] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:40,307 INFO [Listener at localhost/40263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:40,420 INFO [Listener at localhost/40263] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:40,433 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:40,446 INFO [Listener at localhost/40263] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 227) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:38957 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:38957 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40263 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:38957 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:38957 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:38957 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:38957 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,34179,1676671296389)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40263.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38957 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=650 (was 632) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 295), ProcessCount=171 (was 171), AvailableMemoryMB=6690 (was 6743) 2023-02-17 22:01:40,456 INFO [Listener at localhost/40263] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=171, AvailableMemoryMB=6690 2023-02-17 22:01:40,466 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/hadoop.log.dir so I do NOT create it in target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b 2023-02-17 22:01:40,467 WARN [Listener at localhost/40263] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/hadoop.tmp.dir so I do NOT create it in target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b 2023-02-17 22:01:40,467 WARN [Listener at localhost/40263] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f89f57f1-4ae9-63c5-45f1-977485fa1bf4/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 22:01:40,467 DEBUG [Listener at localhost/40263] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460, deleteOnExit=true 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/test.cache.data in system properties and HBase conf 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:01:40,467 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:01:40,468 DEBUG [Listener at localhost/40263] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:01:40,468 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:01:40,469 INFO [Listener at localhost/40263] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:01:40,473 WARN [Listener at localhost/40263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:40,474 WARN [Listener at localhost/40263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:40,512 WARN [Listener at localhost/40263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:40,513 INFO [Listener at localhost/40263] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:40,519 INFO [Listener at localhost/40263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/java.io.tmpdir/Jetty_localhost_37009_hdfs____8exvy7/webapp 2023-02-17 22:01:40,614 INFO [Listener at localhost/40263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37009 2023-02-17 22:01:40,619 WARN [Listener at localhost/40263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:40,619 WARN [Listener at localhost/40263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:40,660 WARN [Listener at localhost/42563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:40,670 WARN [Listener at localhost/42563] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:40,672 WARN [Listener at localhost/42563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:40,673 INFO [Listener at localhost/42563] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:40,680 INFO [Listener at localhost/42563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/java.io.tmpdir/Jetty_localhost_42221_datanode____ojjnkq/webapp 2023-02-17 22:01:40,785 INFO [Listener at localhost/42563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42221 2023-02-17 22:01:40,793 WARN [Listener at localhost/35811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:40,810 WARN [Listener at localhost/35811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:40,812 WARN [Listener at localhost/35811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:40,813 INFO [Listener at localhost/35811] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:40,817 INFO [Listener at localhost/35811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/java.io.tmpdir/Jetty_localhost_45757_datanode____.1cr481/webapp 2023-02-17 22:01:40,892 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe88754fa54119e64: Processing first storage report for DS-2d72c82c-3794-4405-b86a-0e6e62051785 from datanode 31aa01f5-94bb-4c21-a1bc-3aac9fc001b4 2023-02-17 22:01:40,892 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe88754fa54119e64: from storage DS-2d72c82c-3794-4405-b86a-0e6e62051785 node DatanodeRegistration(127.0.0.1:45027, datanodeUuid=31aa01f5-94bb-4c21-a1bc-3aac9fc001b4, infoPort=44485, infoSecurePort=0, ipcPort=35811, storageInfo=lv=-57;cid=testClusterID;nsid=869891918;c=1676671300476), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:40,892 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe88754fa54119e64: Processing first storage report for DS-60ada19a-09a0-4258-b510-de44604e4e8e from datanode 31aa01f5-94bb-4c21-a1bc-3aac9fc001b4 2023-02-17 22:01:40,892 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe88754fa54119e64: from storage DS-60ada19a-09a0-4258-b510-de44604e4e8e node DatanodeRegistration(127.0.0.1:45027, datanodeUuid=31aa01f5-94bb-4c21-a1bc-3aac9fc001b4, infoPort=44485, infoSecurePort=0, ipcPort=35811, storageInfo=lv=-57;cid=testClusterID;nsid=869891918;c=1676671300476), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:40,917 INFO [Listener at localhost/35811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45757 2023-02-17 22:01:40,925 WARN [Listener at localhost/43831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:41,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3261ad080ea35d5: Processing first storage report for DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54 from datanode 470e198a-c281-4d23-a808-8bc701344c29 2023-02-17 22:01:41,020 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3261ad080ea35d5: from storage DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54 node DatanodeRegistration(127.0.0.1:39347, datanodeUuid=470e198a-c281-4d23-a808-8bc701344c29, infoPort=35907, infoSecurePort=0, ipcPort=43831, storageInfo=lv=-57;cid=testClusterID;nsid=869891918;c=1676671300476), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:41,020 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3261ad080ea35d5: Processing first storage report for DS-63325d1c-b0d5-441a-99a1-6cbe8eee5d98 from datanode 470e198a-c281-4d23-a808-8bc701344c29 2023-02-17 22:01:41,021 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3261ad080ea35d5: from storage DS-63325d1c-b0d5-441a-99a1-6cbe8eee5d98 node DatanodeRegistration(127.0.0.1:39347, datanodeUuid=470e198a-c281-4d23-a808-8bc701344c29, infoPort=35907, infoSecurePort=0, ipcPort=43831, storageInfo=lv=-57;cid=testClusterID;nsid=869891918;c=1676671300476), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:41,031 DEBUG [Listener at localhost/43831] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b 2023-02-17 22:01:41,035 INFO [Listener at localhost/43831] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/zookeeper_0, clientPort=63232, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:01:41,037 INFO [Listener at localhost/43831] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63232 2023-02-17 22:01:41,037 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,038 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,062 INFO [Listener at localhost/43831] util.FSUtils(479): Created version file at hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6 with version=8 2023-02-17 22:01:41,062 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,064 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,065 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42563/user/jenkins/test-data/009245da-e355-7a1d-e548-b46508d44a75/hbase-staging 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:41,068 INFO [Listener at localhost/43831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:41,070 INFO [Listener at localhost/43831] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39413 2023-02-17 22:01:41,070 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,071 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,072 INFO [Listener at localhost/43831] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39413 connecting to ZooKeeper ensemble=127.0.0.1:63232 2023-02-17 22:01:41,080 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:394130x0, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:41,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39413-0x100644e95970000 connected 2023-02-17 22:01:41,105 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:41,105 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:41,105 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:41,106 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39413 2023-02-17 22:01:41,107 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39413 2023-02-17 22:01:41,111 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39413 2023-02-17 22:01:41,111 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39413 2023-02-17 22:01:41,111 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39413 2023-02-17 22:01:41,111 INFO [Listener at localhost/43831] master.HMaster(444): hbase.rootdir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6, hbase.cluster.distributed=false 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:41,124 INFO [Listener at localhost/43831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:41,127 INFO [Listener at localhost/43831] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41901 2023-02-17 22:01:41,127 INFO [Listener at localhost/43831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:41,128 DEBUG [Listener at localhost/43831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:41,128 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,129 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,130 INFO [Listener at localhost/43831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41901 connecting to ZooKeeper ensemble=127.0.0.1:63232 2023-02-17 22:01:41,132 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:419010x0, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:41,132 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): regionserver:419010x0, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:41,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41901-0x100644e95970001 connected 2023-02-17 22:01:41,133 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:41,134 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:41,135 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41901 2023-02-17 22:01:41,136 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41901 2023-02-17 22:01:41,137 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41901 2023-02-17 22:01:41,138 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41901 2023-02-17 22:01:41,138 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41901 2023-02-17 22:01:41,149 INFO [Listener at localhost/43831] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:41,149 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,149 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,149 INFO [Listener at localhost/43831] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:41,149 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:41,150 INFO [Listener at localhost/43831] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:41,150 INFO [Listener at localhost/43831] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:41,150 INFO [Listener at localhost/43831] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37303 2023-02-17 22:01:41,151 INFO [Listener at localhost/43831] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:41,151 DEBUG [Listener at localhost/43831] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:41,151 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,152 INFO [Listener at localhost/43831] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,153 INFO [Listener at localhost/43831] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37303 connecting to ZooKeeper ensemble=127.0.0.1:63232 2023-02-17 22:01:41,155 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:373030x0, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:41,156 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): regionserver:373030x0, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:41,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37303-0x100644e95970002 connected 2023-02-17 22:01:41,157 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:41,157 DEBUG [Listener at localhost/43831] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:41,158 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37303 2023-02-17 22:01:41,158 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37303 2023-02-17 22:01:41,159 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37303 2023-02-17 22:01:41,160 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37303 2023-02-17 22:01:41,160 DEBUG [Listener at localhost/43831] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37303 2023-02-17 22:01:41,163 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,166 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:41,166 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,167 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:41,167 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:41,167 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,167 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:41,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:41,171 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,39413,1676671301067 from backup master directory 2023-02-17 22:01:41,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:41,172 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,172 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:41,172 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:41,172 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,189 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/hbase.id with ID: d86bb7d2-3ec6-463a-b456-fb1c2c453ccd 2023-02-17 22:01:41,197 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:41,200 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,209 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x236964a9 to 127.0.0.1:63232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:41,214 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c5a55bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:41,214 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:41,215 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:01:41,216 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:41,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store-tmp 2023-02-17 22:01:41,227 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:41,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:41,228 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:41,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:41,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:41,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:41,228 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:41,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:41,228 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/WALs/jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,231 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39413%2C1676671301067, suffix=, logDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/WALs/jenkins-hbase9.apache.org,39413,1676671301067, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:41,246 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK] 2023-02-17 22:01:41,246 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK] 2023-02-17 22:01:41,251 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/WALs/jenkins-hbase9.apache.org,39413,1676671301067/jenkins-hbase9.apache.org%2C39413%2C1676671301067.1676671301231 2023-02-17 22:01:41,251 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK], DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK]] 2023-02-17 22:01:41,252 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:41,252 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:41,252 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:41,252 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:41,253 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:41,254 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:41,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:41,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:41,257 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:41,261 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:41,268 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:41,268 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73006410, jitterRate=0.08788028359413147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:41,268 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:41,269 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:41,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:41,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:41,270 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:41,271 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 22:01:41,271 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 22:01:41,271 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:41,275 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:41,276 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:41,286 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:41,287 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:41,287 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:41,287 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:41,288 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:41,290 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,291 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:41,291 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:41,292 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:41,293 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:41,294 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:41,294 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,295 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:41,295 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,39413,1676671301067, sessionid=0x100644e95970000, setting cluster-up flag (Was=false) 2023-02-17 22:01:41,303 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,308 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:41,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,312 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,316 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:41,316 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:41,317 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.hbase-snapshot/.tmp 2023-02-17 22:01:41,318 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:41,319 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,321 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671331321 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:41,322 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:41,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,322 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:41,323 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671301323,5,FailOnTimeoutGroup] 2023-02-17 22:01:41,323 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671301323,5,FailOnTimeoutGroup] 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,323 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:41,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,330 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:41,330 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:41,330 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6 2023-02-17 22:01:41,335 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:41,336 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:41,337 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/info 2023-02-17 22:01:41,337 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:41,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:41,338 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:41,339 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:41,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:41,340 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/table 2023-02-17 22:01:41,340 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:41,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,341 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740 2023-02-17 22:01:41,341 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740 2023-02-17 22:01:41,342 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:41,342 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:41,344 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:41,344 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61303411, jitterRate=-0.08650799095630646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:41,344 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:41,344 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:41,344 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:41,344 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:41,344 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:41,345 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:41,345 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:41,345 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:41,345 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:41,345 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:41,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:41,347 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:41,348 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:41,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(952): ClusterId : d86bb7d2-3ec6-463a-b456-fb1c2c453ccd 2023-02-17 22:01:41,363 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(952): ClusterId : d86bb7d2-3ec6-463a-b456-fb1c2c453ccd 2023-02-17 22:01:41,363 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:41,363 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:41,365 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:41,365 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:41,365 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:41,365 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:41,367 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:41,367 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:41,368 DEBUG [RS:0;jenkins-hbase9:41901] zookeeper.ReadOnlyZKClient(139): Connect 0x68cc3ca4 to 127.0.0.1:63232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:41,368 DEBUG [RS:1;jenkins-hbase9:37303] zookeeper.ReadOnlyZKClient(139): Connect 0x72268aea to 127.0.0.1:63232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:41,372 DEBUG [RS:0;jenkins-hbase9:41901] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@660bdfcd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:41,372 DEBUG [RS:0;jenkins-hbase9:41901] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@623457d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:41,373 DEBUG [RS:1;jenkins-hbase9:37303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ce16ade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:41,373 DEBUG [RS:1;jenkins-hbase9:37303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78dee19a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:41,381 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:37303 2023-02-17 22:01:41,381 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:41901 2023-02-17 22:01:41,381 INFO [RS:1;jenkins-hbase9:37303] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:41,381 INFO [RS:0;jenkins-hbase9:41901] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:41,381 INFO [RS:0;jenkins-hbase9:41901] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:41,381 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:41,381 INFO [RS:1;jenkins-hbase9:37303] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:41,382 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:41,382 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,39413,1676671301067 with isa=jenkins-hbase9.apache.org/172.31.2.10:41901, startcode=1676671301123 2023-02-17 22:01:41,382 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,39413,1676671301067 with isa=jenkins-hbase9.apache.org/172.31.2.10:37303, startcode=1676671301149 2023-02-17 22:01:41,382 DEBUG [RS:0;jenkins-hbase9:41901] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:41,382 DEBUG [RS:1;jenkins-hbase9:37303] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:41,384 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38489, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:41,384 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48941, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:41,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39413] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,386 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6 2023-02-17 22:01:41,386 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6 2023-02-17 22:01:41,386 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42563 2023-02-17 22:01:41,386 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42563 2023-02-17 22:01:41,386 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:41,386 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:41,390 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:41,390 DEBUG [RS:0;jenkins-hbase9:41901] zookeeper.ZKUtil(162): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,390 DEBUG [RS:1;jenkins-hbase9:37303] zookeeper.ZKUtil(162): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,390 WARN [RS:0;jenkins-hbase9:41901] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:41,390 WARN [RS:1;jenkins-hbase9:37303] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:41,390 INFO [RS:0;jenkins-hbase9:41901] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:41,390 INFO [RS:1;jenkins-hbase9:37303] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:41,391 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,37303,1676671301149] 2023-02-17 22:01:41,391 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,391 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41901,1676671301123] 2023-02-17 22:01:41,391 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,394 DEBUG [RS:1;jenkins-hbase9:37303] zookeeper.ZKUtil(162): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,394 DEBUG [RS:0;jenkins-hbase9:41901] zookeeper.ZKUtil(162): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,395 DEBUG [RS:1;jenkins-hbase9:37303] zookeeper.ZKUtil(162): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,395 DEBUG [RS:0;jenkins-hbase9:41901] zookeeper.ZKUtil(162): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,395 DEBUG [RS:0;jenkins-hbase9:41901] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:41,395 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:41,396 INFO [RS:1;jenkins-hbase9:37303] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:41,396 INFO [RS:0;jenkins-hbase9:41901] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:41,401 INFO [RS:1;jenkins-hbase9:37303] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:41,401 INFO [RS:0;jenkins-hbase9:41901] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:41,401 INFO [RS:1;jenkins-hbase9:37303] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:41,401 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,402 INFO [RS:0;jenkins-hbase9:41901] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:41,402 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,402 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:41,402 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:41,403 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,403 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:1;jenkins-hbase9:37303] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,405 DEBUG [RS:0;jenkins-hbase9:41901] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:41,406 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,407 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,407 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,407 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,407 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,407 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,419 INFO [RS:1;jenkins-hbase9:37303] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:41,419 INFO [RS:0;jenkins-hbase9:41901] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:41,419 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37303,1676671301149-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,419 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41901,1676671301123-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,430 INFO [RS:0;jenkins-hbase9:41901] regionserver.Replication(203): jenkins-hbase9.apache.org,41901,1676671301123 started 2023-02-17 22:01:41,431 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,41901,1676671301123, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41901, sessionid=0x100644e95970001 2023-02-17 22:01:41,431 INFO [RS:1;jenkins-hbase9:37303] regionserver.Replication(203): jenkins-hbase9.apache.org,37303,1676671301149 started 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41901,1676671301123' 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:41,431 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,37303,1676671301149, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:37303, sessionid=0x100644e95970002 2023-02-17 22:01:41,431 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:41,431 DEBUG [RS:1;jenkins-hbase9:37303] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,431 DEBUG [RS:1;jenkins-hbase9:37303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37303,1676671301149' 2023-02-17 22:01:41,431 DEBUG [RS:1;jenkins-hbase9:37303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:41,431 DEBUG [RS:1;jenkins-hbase9:37303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41901,1676671301123' 2023-02-17 22:01:41,431 DEBUG [RS:0;jenkins-hbase9:41901] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:41,431 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:41,432 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:41,432 DEBUG [RS:1;jenkins-hbase9:37303] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,432 DEBUG [RS:1;jenkins-hbase9:37303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,37303,1676671301149' 2023-02-17 22:01:41,432 DEBUG [RS:1;jenkins-hbase9:37303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:41,432 DEBUG [RS:0;jenkins-hbase9:41901] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:41,432 DEBUG [RS:1;jenkins-hbase9:37303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:41,432 DEBUG [RS:0;jenkins-hbase9:41901] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:41,432 INFO [RS:0;jenkins-hbase9:41901] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:41,432 INFO [RS:0;jenkins-hbase9:41901] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:41,432 DEBUG [RS:1;jenkins-hbase9:37303] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:41,432 INFO [RS:1;jenkins-hbase9:37303] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:41,432 INFO [RS:1;jenkins-hbase9:37303] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:41,498 DEBUG [jenkins-hbase9:39413] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:41,498 DEBUG [jenkins-hbase9:39413] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:41,500 DEBUG [jenkins-hbase9:39413] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:41,500 DEBUG [jenkins-hbase9:39413] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:41,500 DEBUG [jenkins-hbase9:39413] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:41,500 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37303,1676671301149, state=OPENING 2023-02-17 22:01:41,502 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:41,504 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:41,504 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:41,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37303,1676671301149}] 2023-02-17 22:01:41,662 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,663 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:41,664 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33678, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:41,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:41,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:41,669 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37303%2C1676671301149.meta, suffix=.meta, logDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,37303,1676671301149, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/oldWALs, maxLogs=32 2023-02-17 22:01:41,682 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK] 2023-02-17 22:01:41,683 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK] 2023-02-17 22:01:41,684 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,37303,1676671301149/jenkins-hbase9.apache.org%2C37303%2C1676671301149.meta.1676671301670.meta 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK], DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK]] 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:41,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:41,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:41,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:41,687 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/info 2023-02-17 22:01:41,687 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/info 2023-02-17 22:01:41,688 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:41,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:41,689 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:41,689 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:41,689 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:41,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:41,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/table 2023-02-17 22:01:41,690 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/table 2023-02-17 22:01:41,690 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:41,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:41,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740 2023-02-17 22:01:41,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740 2023-02-17 22:01:41,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:41,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:41,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71769105, jitterRate=0.0694430023431778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:41,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:41,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671301662 2023-02-17 22:01:41,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:41,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:41,703 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,37303,1676671301149, state=OPEN 2023-02-17 22:01:41,705 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:41,705 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:41,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:41,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,37303,1676671301149 in 201 msec 2023-02-17 22:01:41,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:41,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-17 22:01:41,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-17 22:01:41,709 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671301709, completionTime=-1 2023-02-17 22:01:41,709 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:41,709 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:41,710 DEBUG [hconnection-0x1d364ec5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:41,712 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33692, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:41,713 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:41,713 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671361713 2023-02-17 22:01:41,713 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671421713 2023-02-17 22:01:41,713 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-17 22:01:41,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39413,1676671301067-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39413,1676671301067-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39413,1676671301067-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:39413, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:41,724 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:41,725 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:41,725 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:41,725 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:41,727 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:41,727 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:41,728 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:41,729 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc empty. 2023-02-17 22:01:41,729 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:41,729 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:41,737 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:41,738 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 133c03292f08eec3e4bde4e9af4b5fdc, NAME => 'hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp 2023-02-17 22:01:41,743 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:41,743 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 133c03292f08eec3e4bde4e9af4b5fdc, disabling compactions & flushes 2023-02-17 22:01:41,743 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:41,743 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:41,743 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. after waiting 0 ms 2023-02-17 22:01:41,743 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:41,743 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:41,743 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 133c03292f08eec3e4bde4e9af4b5fdc: 2023-02-17 22:01:41,745 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:41,746 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671301745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671301745"}]},"ts":"1676671301745"} 2023-02-17 22:01:41,747 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:41,747 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:41,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671301747"}]},"ts":"1676671301747"} 2023-02-17 22:01:41,748 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:41,751 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:41,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:41,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:41,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:41,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=133c03292f08eec3e4bde4e9af4b5fdc, ASSIGN}] 2023-02-17 22:01:41,754 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=133c03292f08eec3e4bde4e9af4b5fdc, ASSIGN 2023-02-17 22:01:41,754 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=133c03292f08eec3e4bde4e9af4b5fdc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,37303,1676671301149; forceNewPlan=false, retain=false 2023-02-17 22:01:41,905 INFO [jenkins-hbase9:39413] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:41,905 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=133c03292f08eec3e4bde4e9af4b5fdc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:41,905 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671301905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671301905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671301905"}]},"ts":"1676671301905"} 2023-02-17 22:01:41,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 133c03292f08eec3e4bde4e9af4b5fdc, server=jenkins-hbase9.apache.org,37303,1676671301149}] 2023-02-17 22:01:42,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:42,064 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37303%2C1676671301149, suffix=, logDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,37303,1676671301149, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/oldWALs, maxLogs=32 2023-02-17 22:01:42,078 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK] 2023-02-17 22:01:42,078 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK] 2023-02-17 22:01:42,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,37303,1676671301149/jenkins-hbase9.apache.org%2C37303%2C1676671301149.1676671302064 2023-02-17 22:01:42,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK], DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK]] 2023-02-17 22:01:42,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 133c03292f08eec3e4bde4e9af4b5fdc, NAME => 'hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:42,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:42,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,082 INFO [StoreOpener-133c03292f08eec3e4bde4e9af4b5fdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,083 DEBUG [StoreOpener-133c03292f08eec3e4bde4e9af4b5fdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/info 2023-02-17 22:01:42,083 DEBUG [StoreOpener-133c03292f08eec3e4bde4e9af4b5fdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/info 2023-02-17 22:01:42,083 INFO [StoreOpener-133c03292f08eec3e4bde4e9af4b5fdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 133c03292f08eec3e4bde4e9af4b5fdc columnFamilyName info 2023-02-17 22:01:42,084 INFO [StoreOpener-133c03292f08eec3e4bde4e9af4b5fdc-1] regionserver.HStore(310): Store=133c03292f08eec3e4bde4e9af4b5fdc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:42,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:42,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:42,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 133c03292f08eec3e4bde4e9af4b5fdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61856743, jitterRate=-0.07826270163059235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:42,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 133c03292f08eec3e4bde4e9af4b5fdc: 2023-02-17 22:01:42,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc., pid=6, masterSystemTime=1676671302058 2023-02-17 22:01:42,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:42,091 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:42,092 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=133c03292f08eec3e4bde4e9af4b5fdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:42,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671302092"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671302092"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671302092"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671302092"}]},"ts":"1676671302092"} 2023-02-17 22:01:42,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:42,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 133c03292f08eec3e4bde4e9af4b5fdc, server=jenkins-hbase9.apache.org,37303,1676671301149 in 186 msec 2023-02-17 22:01:42,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:42,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=133c03292f08eec3e4bde4e9af4b5fdc, ASSIGN in 342 msec 2023-02-17 22:01:42,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:42,096 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671302096"}]},"ts":"1676671302096"} 2023-02-17 22:01:42,097 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:42,099 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:42,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 374 msec 2023-02-17 22:01:42,126 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:42,129 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:42,129 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:42,133 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:42,140 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:42,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 22:01:42,144 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:42,151 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:42,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-17 22:01:42,170 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:42,179 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:42,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.007sec 2023-02-17 22:01:42,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:42,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:42,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:42,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39413,1676671301067-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:42,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39413,1676671301067-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:42,181 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:42,264 DEBUG [Listener at localhost/43831] zookeeper.ReadOnlyZKClient(139): Connect 0x208e8899 to 127.0.0.1:63232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:42,267 DEBUG [Listener at localhost/43831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d60132b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:42,268 DEBUG [hconnection-0x1f475e27-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:42,270 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33704, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:42,271 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:42,271 DEBUG [Listener at localhost/43831] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:42,273 DEBUG [Listener at localhost/43831] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:42,275 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:42,275 INFO [Listener at localhost/43831] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:42,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:42,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:42,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.2.10:56996 deadline: 1676671362276, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:42,276 INFO [Listener at localhost/43831] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 22:01:42,278 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:42,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:42,280 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:42,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-17 22:01:42,280 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:42,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:42,282 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,282 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b empty. 2023-02-17 22:01:42,282 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,282 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-17 22:01:42,291 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:42,292 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 09958d58a2268caa5962afcb2365c18b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp 2023-02-17 22:01:42,300 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:42,300 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 09958d58a2268caa5962afcb2365c18b, disabling compactions & flushes 2023-02-17 22:01:42,300 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,300 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,300 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. after waiting 0 ms 2023-02-17 22:01:42,300 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,300 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,300 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 09958d58a2268caa5962afcb2365c18b: 2023-02-17 22:01:42,302 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:42,303 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676671302303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671302303"}]},"ts":"1676671302303"} 2023-02-17 22:01:42,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:42,304 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:42,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671302304"}]},"ts":"1676671302304"} 2023-02-17 22:01:42,305 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-17 22:01:42,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:42,309 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:42,309 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:42,309 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:42,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, ASSIGN}] 2023-02-17 22:01:42,311 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, ASSIGN 2023-02-17 22:01:42,311 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41901,1676671301123; forceNewPlan=false, retain=false 2023-02-17 22:01:42,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:42,434 INFO [RS:0;jenkins-hbase9:41901] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41901%2C1676671301123, suffix=, logDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,41901,1676671301123, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/oldWALs, maxLogs=32 2023-02-17 22:01:42,454 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK] 2023-02-17 22:01:42,459 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK] 2023-02-17 22:01:42,462 INFO [jenkins-hbase9:39413] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:42,462 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=09958d58a2268caa5962afcb2365c18b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:42,462 INFO [RS:0;jenkins-hbase9:41901] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/WALs/jenkins-hbase9.apache.org,41901,1676671301123/jenkins-hbase9.apache.org%2C41901%2C1676671301123.1676671302435 2023-02-17 22:01:42,462 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676671302462"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671302462"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671302462"}]},"ts":"1676671302462"} 2023-02-17 22:01:42,463 DEBUG [RS:0;jenkins-hbase9:41901] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39347,DS-d722fef5-ed1c-4e6c-899f-a3e903c8cd54,DISK], DatanodeInfoWithStorage[127.0.0.1:45027,DS-2d72c82c-3794-4405-b86a-0e6e62051785,DISK]] 2023-02-17 22:01:42,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 09958d58a2268caa5962afcb2365c18b, server=jenkins-hbase9.apache.org,41901,1676671301123}] 2023-02-17 22:01:42,468 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 22:01:42,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:42,617 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:42,617 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:42,619 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:42,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 09958d58a2268caa5962afcb2365c18b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,623 INFO [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,625 DEBUG [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1 2023-02-17 22:01:42,625 DEBUG [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1 2023-02-17 22:01:42,625 INFO [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09958d58a2268caa5962afcb2365c18b columnFamilyName f1 2023-02-17 22:01:42,625 INFO [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] regionserver.HStore(310): Store=09958d58a2268caa5962afcb2365c18b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:42,626 INFO [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,626 DEBUG [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2 2023-02-17 22:01:42,627 DEBUG [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2 2023-02-17 22:01:42,627 INFO [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09958d58a2268caa5962afcb2365c18b columnFamilyName f2 2023-02-17 22:01:42,627 INFO [StoreOpener-09958d58a2268caa5962afcb2365c18b-1] regionserver.HStore(310): Store=09958d58a2268caa5962afcb2365c18b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:42,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:42,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:42,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:42,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 09958d58a2268caa5962afcb2365c18b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64367715, jitterRate=-0.04084630310535431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:42,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 09958d58a2268caa5962afcb2365c18b: 2023-02-17 22:01:42,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b., pid=12, masterSystemTime=1676671302616 2023-02-17 22:01:42,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:42,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=09958d58a2268caa5962afcb2365c18b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:42,638 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676671302638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671302638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671302638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671302638"}]},"ts":"1676671302638"} 2023-02-17 22:01:42,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 22:01:42,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 09958d58a2268caa5962afcb2365c18b, server=jenkins-hbase9.apache.org,41901,1676671301123 in 176 msec 2023-02-17 22:01:42,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 22:01:42,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, ASSIGN in 332 msec 2023-02-17 22:01:42,644 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:42,644 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671302644"}]},"ts":"1676671302644"} 2023-02-17 22:01:42,645 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-17 22:01:42,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:42,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 374 msec 2023-02-17 22:01:42,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:42,886 INFO [Listener at localhost/43831] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-17 22:01:42,886 DEBUG [Listener at localhost/43831] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-17 22:01:42,887 INFO [Listener at localhost/43831] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:42,889 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-17 22:01:42,889 INFO [Listener at localhost/43831] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:42,889 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-17 22:01:42,889 INFO [Listener at localhost/43831] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:42,903 DEBUG [hconnection-0x1f475e27-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:42,917 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35760, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:42,923 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41901] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,006 INFO [Listener at localhost/43831] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:43,006 INFO [Listener at localhost/43831] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:43,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 22:01:43,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671303007 (current time:1676671303007). 2023-02-17 22:01:43,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:43,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] zookeeper.ReadOnlyZKClient(139): Connect 0x57fef2d9 to 127.0.0.1:63232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:43,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7151926c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:43,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:43,013 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:43,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57fef2d9 to 127.0.0.1:63232 2023-02-17 22:01:43,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:43,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:43,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 22:01:43,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 22:01:43,017 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 22:01:43,017 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676671903017 2023-02-17 22:01:43,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 22:01:43,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,018 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:43,019 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:43,019 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 22:01:43,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 22:01:43,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-17 22:01:43,021 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 22:01:43,021 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676671903021 2023-02-17 22:01:43,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-17 22:01:43,028 INFO [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-17 22:01:43,028 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:43,029 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-17 22:01:43,029 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-17 22:01:43,029 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,029 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,031 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:43,031 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:43,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:43,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:43,031 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,032 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,032 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-17 22:01:43,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-17 22:01:43,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 22:01:43,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 22:01:43,033 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 22:01:43,033 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:43,033 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 22:01:43,033 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 22:01:43,033 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:43,033 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 22:01:43,034 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41901,1676671301123' joining acquired barrier for procedure (foo) in zk 2023-02-17 22:01:43,034 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 22:01:43,034 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 22:01:43,034 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37303,1676671301149' joining acquired barrier for procedure (foo) in zk 2023-02-17 22:01:43,036 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,036 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,036 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:43,036 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,036 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:43,036 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,036 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:43,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41901,1676671301123' joining acquired barrier for procedure 'foo' on coordinator 2023-02-17 22:01:43,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c55a0c8[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:43,038 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-17 22:01:43,038 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,039 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 22:01:43,039 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 22:01:43,039 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,039 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:43,039 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 22:01:43,039 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,37303,1676671301149' in zk 2023-02-17 22:01:43,039 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 22:01:43,039 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:43,039 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,039 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. started... 2023-02-17 22:01:43,039 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 09958d58a2268caa5962afcb2365c18b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 22:01:43,040 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 22:01:43,040 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:43,041 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 22:01:43,052 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f1/91cead31663e4353803b99fa270eb778 2023-02-17 22:01:43,072 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f2/8d271f8244ba476392b5c8c13a613b96 2023-02-17 22:01:43,078 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f1/91cead31663e4353803b99fa270eb778 as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778 2023-02-17 22:01:43,082 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:43,083 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f2/8d271f8244ba476392b5c8c13a613b96 as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96 2023-02-17 22:01:43,090 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:43,091 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 09958d58a2268caa5962afcb2365c18b in 52ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:43,091 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 09958d58a2268caa5962afcb2365c18b: 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.' region-info for snapshot=foo 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778] hfiles 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778 for snapshot=foo 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96] hfiles 2023-02-17 22:01:43,092 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96 for snapshot=foo 2023-02-17 22:01:43,105 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. completed. 2023-02-17 22:01:43,105 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,105 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 22:01:43,105 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 22:01:43,105 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,105 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 22:01:43,105 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase9.apache.org,41901,1676671301123' in zk 2023-02-17 22:01:43,108 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 22:01:43,108 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:43,108 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 22:01:43,108 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase9.apache.org,41901,1676671301123': 2023-02-17 22:01:43,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41901,1676671301123' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-17 22:01:43,112 INFO [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-17 22:01:43,112 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:43,113 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:43,113 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-17 22:01:43,113 INFO [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:43,114 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,114 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,114 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:43,115 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,115 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:43,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:43,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,117 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,118 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:43,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:43,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:43,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,119 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:43,119 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,120 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 22:01:43,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-17 22:01:43,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:43,121 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:43,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,127 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:43,127 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:43,127 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:43,127 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:43,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:43,128 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:43,127 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:43,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-17 22:01:43,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-17 22:01:43,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:43,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-17 22:01:43,127 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,128 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,128 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 22:01:43,128 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:43,128 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,128 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.hbase-snapshot/.tmp/foo 2023-02-17 22:01:43,128 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 22:01:43,129 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 22:01:43,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.hbase-snapshot/.tmp/foo to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.hbase-snapshot/foo 2023-02-17 22:01:43,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-17 22:01:43,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.hbase-snapshot/.tmp/foo 2023-02-17 22:01:43,161 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.hbase-snapshot/.tmp/foo 2023-02-17 22:01:43,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676671303018Consolidate snapshot: foo at 1676671303128 (+110 ms)Loading Region manifests for foo at 1676671303128Writing data manifest for foo at 1676671303131 (+3 ms)Verifying snapshot: foo at 1676671303139 (+8 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676671303161 (+22 ms) 2023-02-17 22:01:43,163 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 22:01:43,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 145 msec 2023-02-17 22:01:43,322 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:43,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-17 22:01:43,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:43,324 INFO [Listener at localhost/43831] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:43,327 INFO [Listener at localhost/43831] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:43,332 INFO [Listener at localhost/43831] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:43,418 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41901] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,711 INFO [Listener at localhost/43831] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:43,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:43,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,717 INFO [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 22:01:43,717 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:43,718 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-17 22:01:43,718 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-17 22:01:43,719 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,719 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,720 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:43,720 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:43,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:43,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:43,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:43,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:43,720 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,720 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,721 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,722 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-17 22:01:43,722 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:43,722 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-17 22:01:43,722 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:43,722 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-17 22:01:43,722 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-17 22:01:43,723 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,37303,1676671301149' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-17 22:01:43,723 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-17 22:01:43,723 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 22:01:43,723 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:43,723 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,723 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. started... 2023-02-17 22:01:43,723 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09958d58a2268caa5962afcb2365c18b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 22:01:43,724 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,725 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,725 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:43,738 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f1/3e8e0d91da2e408390b1e75d14e5fae3 2023-02-17 22:01:43,758 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f2/004d9abd441e42c8971e6b4481a2e26a 2023-02-17 22:01:43,762 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f1/3e8e0d91da2e408390b1e75d14e5fae3 as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/3e8e0d91da2e408390b1e75d14e5fae3 2023-02-17 22:01:43,766 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/3e8e0d91da2e408390b1e75d14e5fae3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:43,767 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/.tmp/f2/004d9abd441e42c8971e6b4481a2e26a as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/004d9abd441e42c8971e6b4481a2e26a 2023-02-17 22:01:43,771 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/004d9abd441e42c8971e6b4481a2e26a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:43,772 INFO [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 09958d58a2268caa5962afcb2365c18b in 49ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:43,773 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09958d58a2268caa5962afcb2365c18b: 2023-02-17 22:01:43,773 DEBUG [rs(jenkins-hbase9.apache.org,41901,1676671301123)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 22:01:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 22:01:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-17 22:01:43,773 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41901,1676671301123' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-17 22:01:43,775 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,775 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:43,775 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,775 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:43,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41901,1676671301123' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-17 22:01:43,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@486a2d9a[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:43,777 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-17 22:01:43,777 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,779 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-17 22:01:43,779 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,779 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-17 22:01:43,780 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-17 22:01:43,780 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-17 22:01:43,780 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase9.apache.org,41901,1676671301123' in zk 2023-02-17 22:01:43,780 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase9.apache.org,37303,1676671301149' in zk 2023-02-17 22:01:43,781 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-17 22:01:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-17 22:01:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,41901,1676671301123' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-17 22:01:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,37303,1676671301149' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-17 22:01:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase9.apache.org,41901,1676671301123': 2023-02-17 22:01:43,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41901,1676671301123' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-17 22:01:43,784 INFO [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-17 22:01:43,784 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:43,784 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:43,785 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,785 INFO [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:43,786 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,786 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,786 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,786 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,786 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,787 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:43,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:43,787 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,789 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,789 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 22:01:43,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,792 DEBUG [(jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:43,792 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:43,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,793 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,893 DEBUG [Listener at localhost/43831] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:43,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:43,907 INFO [Listener at localhost/43831] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676671303007 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:43,907 DEBUG [Listener at localhost/43831] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42563/user/jenkins/test-data/009245da-e355-7a1d-e548-b46508d44a75/foo/206c8b30-21ec-4af2-89b7-1500b84e68e1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,907 INFO [Listener at localhost/43831] snapshot.RestoreSnapshotHelper(239): region to add: 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:43,908 INFO [Listener at localhost/43831] snapshot.RestoreSnapshotHelper(585): clone region=09958d58a2268caa5962afcb2365c18b as 09958d58a2268caa5962afcb2365c18b in snapshot foo 2023-02-17 22:01:43,908 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 09958d58a2268caa5962afcb2365c18b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/009245da-e355-7a1d-e548-b46508d44a75/foo/206c8b30-21ec-4af2-89b7-1500b84e68e1 2023-02-17 22:01:43,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:43,916 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91cead31663e4353803b99fa270eb778 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,919 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8d271f8244ba476392b5c8c13a613b96 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,921 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 09958d58a2268caa5962afcb2365c18b, disabling compactions & flushes 2023-02-17 22:01:43,922 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,922 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,922 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. after waiting 0 ms 2023-02-17 22:01:43,922 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,922 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:43,922 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 09958d58a2268caa5962afcb2365c18b: 2023-02-17 22:01:43,924 INFO [Listener at localhost/43831] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676671303007 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:43,924 DEBUG [Listener at localhost/43831] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42563/user/jenkins/test-data/009245da-e355-7a1d-e548-b46508d44a75/foo/206c8b30-21ec-4af2-89b7-1500b84e68e1 2023-02-17 22:01:43,924 DEBUG [Listener at localhost/43831] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42563/user/jenkins/test-data/009245da-e355-7a1d-e548-b46508d44a75/foo/206c8b30-21ec-4af2-89b7-1500b84e68e1 2023-02-17 22:01:43,925 DEBUG [Listener at localhost/43831] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:43,925 DEBUG [Listener at localhost/43831] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:43,926 DEBUG [Listener at localhost/43831] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-17 22:01:43,926 DEBUG [Listener at localhost/43831] util.CommonFSUtils(699): |----------09958d58a2268caa5962afcb2365c18b/ 2023-02-17 22:01:43,927 DEBUG [Listener at localhost/43831] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:43,927 DEBUG [Listener at localhost/43831] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:43,928 DEBUG [Listener at localhost/43831] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=09958d58a2268caa5962afcb2365c18b-91cead31663e4353803b99fa270eb778 2023-02-17 22:01:43,928 DEBUG [Listener at localhost/43831] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:43,928 DEBUG [Listener at localhost/43831] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=09958d58a2268caa5962afcb2365c18b-8d271f8244ba476392b5c8c13a613b96 hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/3e8e0d91da2e408390b1e75d14e5fae3 hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778 hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/004d9abd441e42c8971e6b4481a2e26a hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96 2023-02-17 22:01:43,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "foo" 2023-02-17 22:01:43,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-17 22:01:43,941 INFO [Listener at localhost/43831] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,941 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:43,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:43,945 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671303945"}]},"ts":"1676671303945"} 2023-02-17 22:01:43,946 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-17 22:01:43,948 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-17 22:01:43,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, UNASSIGN}] 2023-02-17 22:01:43,950 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, UNASSIGN 2023-02-17 22:01:43,950 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=09958d58a2268caa5962afcb2365c18b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:43,950 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676671303950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671303950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671303950"}]},"ts":"1676671303950"} 2023-02-17 22:01:43,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 09958d58a2268caa5962afcb2365c18b, server=jenkins-hbase9.apache.org,41901,1676671301123}] 2023-02-17 22:01:44,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:44,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:44,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 09958d58a2268caa5962afcb2365c18b, disabling compactions & flushes 2023-02-17 22:01:44,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:44,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:44,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. after waiting 0 ms 2023-02-17 22:01:44,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:44,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:44,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b. 2023-02-17 22:01:44,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 09958d58a2268caa5962afcb2365c18b: 2023-02-17 22:01:44,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:44,109 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=09958d58a2268caa5962afcb2365c18b, regionState=CLOSED 2023-02-17 22:01:44,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676671304109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671304109"}]},"ts":"1676671304109"} 2023-02-17 22:01:44,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 22:01:44,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 09958d58a2268caa5962afcb2365c18b, server=jenkins-hbase9.apache.org,41901,1676671301123 in 159 msec 2023-02-17 22:01:44,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 22:01:44,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=09958d58a2268caa5962afcb2365c18b, UNASSIGN in 163 msec 2023-02-17 22:01:44,113 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671304113"}]},"ts":"1676671304113"} 2023-02-17 22:01:44,114 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-17 22:01:44,116 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-17 22:01:44,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 174 msec 2023-02-17 22:01:44,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:44,248 INFO [Listener at localhost/43831] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-17 22:01:44,249 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:44,255 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:44,257 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/recovered.edits] 2023-02-17 22:01:44,261 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/3e8e0d91da2e408390b1e75d14e5fae3 to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/3e8e0d91da2e408390b1e75d14e5fae3 2023-02-17 22:01:44,263 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778 to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f1/91cead31663e4353803b99fa270eb778 2023-02-17 22:01:44,266 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/004d9abd441e42c8971e6b4481a2e26a to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/004d9abd441e42c8971e6b4481a2e26a 2023-02-17 22:01:44,268 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96 to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/f2/8d271f8244ba476392b5c8c13a613b96 2023-02-17 22:01:44,271 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b/recovered.edits/12.seqid 2023-02-17 22:01:44,272 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/09958d58a2268caa5962afcb2365c18b 2023-02-17 22:01:44,272 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-17 22:01:44,274 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,276 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-17 22:01:44,278 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-17 22:01:44,282 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,282 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-17 22:01:44,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671304282"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:44,284 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 22:01:44,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 09958d58a2268caa5962afcb2365c18b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676671302278.09958d58a2268caa5962afcb2365c18b.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 22:01:44,284 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-17 22:01:44,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676671304284"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:44,285 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-17 22:01:44,288 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 22:01:44,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 39 msec 2023-02-17 22:01:44,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39413] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:44,354 INFO [Listener at localhost/43831] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-17 22:01:44,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:44,355 INFO [Listener at localhost/43831] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:44,355 DEBUG [Listener at localhost/43831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x208e8899 to 127.0.0.1:63232 2023-02-17 22:01:44,355 DEBUG [Listener at localhost/43831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,355 DEBUG [Listener at localhost/43831] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:44,355 DEBUG [Listener at localhost/43831] util.JVMClusterUtil(257): Found active master hash=195934338, stopped=false 2023-02-17 22:01:44,355 INFO [Listener at localhost/43831] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:44,357 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:44,357 INFO [Listener at localhost/43831] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:44,357 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:44,357 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:44,357 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:44,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:44,359 DEBUG [Listener at localhost/43831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x236964a9 to 127.0.0.1:63232 2023-02-17 22:01:44,359 DEBUG [Listener at localhost/43831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:44,359 INFO [Listener at localhost/43831] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,41901,1676671301123' ***** 2023-02-17 22:01:44,359 INFO [Listener at localhost/43831] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:44,360 INFO [Listener at localhost/43831] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,37303,1676671301149' ***** 2023-02-17 22:01:44,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:44,360 INFO [Listener at localhost/43831] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:44,360 INFO [RS:0;jenkins-hbase9:41901] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:44,360 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:44,360 INFO [RS:0;jenkins-hbase9:41901] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:44,361 INFO [RS:0;jenkins-hbase9:41901] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:44,361 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:44,361 DEBUG [RS:0;jenkins-hbase9:41901] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68cc3ca4 to 127.0.0.1:63232 2023-02-17 22:01:44,361 DEBUG [RS:0;jenkins-hbase9:41901] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,361 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,41901,1676671301123; all regions closed. 2023-02-17 22:01:44,360 INFO [RS:1;jenkins-hbase9:37303] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:44,362 INFO [RS:1;jenkins-hbase9:37303] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:44,362 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:44,362 INFO [RS:1;jenkins-hbase9:37303] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(3304): Received CLOSE for 133c03292f08eec3e4bde4e9af4b5fdc 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:44,363 DEBUG [RS:1;jenkins-hbase9:37303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72268aea to 127.0.0.1:63232 2023-02-17 22:01:44,363 DEBUG [RS:1;jenkins-hbase9:37303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 133c03292f08eec3e4bde4e9af4b5fdc, disabling compactions & flushes 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:44,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:44,363 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 22:01:44,363 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1479): Online Regions={133c03292f08eec3e4bde4e9af4b5fdc=hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc., 1588230740=hbase:meta,,1.1588230740} 2023-02-17 22:01:44,364 DEBUG [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1505): Waiting on 133c03292f08eec3e4bde4e9af4b5fdc, 1588230740 2023-02-17 22:01:44,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:44,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:44,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:44,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:44,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:44,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-17 22:01:44,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:44,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. after waiting 0 ms 2023-02-17 22:01:44,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:44,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 133c03292f08eec3e4bde4e9af4b5fdc 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:44,369 DEBUG [RS:0;jenkins-hbase9:41901] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/oldWALs 2023-02-17 22:01:44,369 INFO [RS:0;jenkins-hbase9:41901] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41901%2C1676671301123:(num 1676671302435) 2023-02-17 22:01:44,369 DEBUG [RS:0;jenkins-hbase9:41901] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,369 INFO [RS:0;jenkins-hbase9:41901] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:44,369 INFO [RS:0;jenkins-hbase9:41901] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:44,369 INFO [RS:0;jenkins-hbase9:41901] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:44,369 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:44,369 INFO [RS:0;jenkins-hbase9:41901] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:44,370 INFO [RS:0;jenkins-hbase9:41901] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:44,371 INFO [RS:0;jenkins-hbase9:41901] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41901 2023-02-17 22:01:44,383 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/.tmp/info/1d35f0f0764c45ccabc03a50e8348ca9 2023-02-17 22:01:44,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/.tmp/info/c43103ffec59404f927f2e3cce12f938 2023-02-17 22:01:44,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d35f0f0764c45ccabc03a50e8348ca9 2023-02-17 22:01:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/.tmp/info/c43103ffec59404f927f2e3cce12f938 as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/info/c43103ffec59404f927f2e3cce12f938 2023-02-17 22:01:44,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/info/c43103ffec59404f927f2e3cce12f938, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:44,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 133c03292f08eec3e4bde4e9af4b5fdc in 30ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:44,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/.tmp/rep_barrier/9a81288c491844a18d79d9680928ddc5 2023-02-17 22:01:44,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/namespace/133c03292f08eec3e4bde4e9af4b5fdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:44,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:44,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 133c03292f08eec3e4bde4e9af4b5fdc: 2023-02-17 22:01:44,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671301725.133c03292f08eec3e4bde4e9af4b5fdc. 2023-02-17 22:01:44,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a81288c491844a18d79d9680928ddc5 2023-02-17 22:01:44,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/.tmp/table/8f0bdaf035e34be984afa47716a1996e 2023-02-17 22:01:44,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f0bdaf035e34be984afa47716a1996e 2023-02-17 22:01:44,409 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/.tmp/info/1d35f0f0764c45ccabc03a50e8348ca9 as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/info/1d35f0f0764c45ccabc03a50e8348ca9 2023-02-17 22:01:44,411 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:44,411 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:44,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d35f0f0764c45ccabc03a50e8348ca9 2023-02-17 22:01:44,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/info/1d35f0f0764c45ccabc03a50e8348ca9, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 22:01:44,414 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/.tmp/rep_barrier/9a81288c491844a18d79d9680928ddc5 as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/rep_barrier/9a81288c491844a18d79d9680928ddc5 2023-02-17 22:01:44,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a81288c491844a18d79d9680928ddc5 2023-02-17 22:01:44,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/rep_barrier/9a81288c491844a18d79d9680928ddc5, entries=1, sequenceid=21, filesize=5.1 K 2023-02-17 22:01:44,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/.tmp/table/8f0bdaf035e34be984afa47716a1996e as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/table/8f0bdaf035e34be984afa47716a1996e 2023-02-17 22:01:44,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f0bdaf035e34be984afa47716a1996e 2023-02-17 22:01:44,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/table/8f0bdaf035e34be984afa47716a1996e, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 22:01:44,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false 2023-02-17 22:01:44,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 22:01:44,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:44,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:44,428 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:44,428 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:44,466 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:44,466 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:44,466 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41901,1676671301123 2023-02-17 22:01:44,466 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:44,466 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10e5e5a1 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,467 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:44,467 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f34a704 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,467 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41901,1676671301123] 2023-02-17 22:01:44,468 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41901,1676671301123; numProcessing=1 2023-02-17 22:01:44,470 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41901,1676671301123 already deleted, retry=false 2023-02-17 22:01:44,470 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41901,1676671301123 expired; onlineServers=1 2023-02-17 22:01:44,471 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 22:01:44,471 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 22:01:44,564 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,37303,1676671301149; all regions closed. 2023-02-17 22:01:44,567 DEBUG [RS:1;jenkins-hbase9:37303] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/oldWALs 2023-02-17 22:01:44,567 INFO [RS:1;jenkins-hbase9:37303] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37303%2C1676671301149.meta:.meta(num 1676671301670) 2023-02-17 22:01:44,572 DEBUG [RS:1;jenkins-hbase9:37303] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/oldWALs 2023-02-17 22:01:44,572 INFO [RS:1;jenkins-hbase9:37303] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C37303%2C1676671301149:(num 1676671302064) 2023-02-17 22:01:44,572 DEBUG [RS:1;jenkins-hbase9:37303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,572 INFO [RS:1;jenkins-hbase9:37303] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:44,573 INFO [RS:1;jenkins-hbase9:37303] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:44,573 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:44,573 INFO [RS:1;jenkins-hbase9:37303] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37303 2023-02-17 22:01:44,575 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,37303,1676671301149 2023-02-17 22:01:44,575 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:44,575 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f34c2af rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,576 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,37303,1676671301149] 2023-02-17 22:01:44,576 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,37303,1676671301149; numProcessing=2 2023-02-17 22:01:44,577 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,37303,1676671301149 already deleted, retry=false 2023-02-17 22:01:44,577 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,37303,1676671301149 expired; onlineServers=0 2023-02-17 22:01:44,577 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,39413,1676671301067' ***** 2023-02-17 22:01:44,577 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:44,578 DEBUG [M:0;jenkins-hbase9:39413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f923d2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:44,578 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,39413,1676671301067 2023-02-17 22:01:44,578 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,39413,1676671301067; all regions closed. 2023-02-17 22:01:44,578 DEBUG [M:0;jenkins-hbase9:39413] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:44,578 DEBUG [M:0;jenkins-hbase9:39413] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:44,578 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:44,578 DEBUG [M:0;jenkins-hbase9:39413] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:44,578 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671301323] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671301323,5,FailOnTimeoutGroup] 2023-02-17 22:01:44,578 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671301323] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671301323,5,FailOnTimeoutGroup] 2023-02-17 22:01:44,578 INFO [M:0;jenkins-hbase9:39413] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:44,579 INFO [M:0;jenkins-hbase9:39413] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:44,580 INFO [M:0;jenkins-hbase9:39413] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:44,580 DEBUG [M:0;jenkins-hbase9:39413] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:44,580 INFO [M:0;jenkins-hbase9:39413] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:44,580 ERROR [M:0;jenkins-hbase9:39413] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 22:01:44,580 INFO [M:0;jenkins-hbase9:39413] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:44,580 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:44,581 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:44,581 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:44,581 DEBUG [M:0;jenkins-hbase9:39413] zookeeper.ZKUtil(398): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:44,581 WARN [M:0;jenkins-hbase9:39413] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:44,581 INFO [M:0;jenkins-hbase9:39413] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:44,582 INFO [M:0;jenkins-hbase9:39413] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:44,582 DEBUG [M:0;jenkins-hbase9:39413] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:44,582 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:44,582 DEBUG [M:0;jenkins-hbase9:39413] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:44,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:44,582 DEBUG [M:0;jenkins-hbase9:39413] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:44,582 DEBUG [M:0;jenkins-hbase9:39413] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:44,582 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.66 KB heapSize=67.62 KB 2023-02-17 22:01:44,593 INFO [M:0;jenkins-hbase9:39413] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e35565325cbd4852a9cb55a0d4477eee 2023-02-17 22:01:44,597 DEBUG [M:0;jenkins-hbase9:39413] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e35565325cbd4852a9cb55a0d4477eee as hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e35565325cbd4852a9cb55a0d4477eee 2023-02-17 22:01:44,600 INFO [M:0;jenkins-hbase9:39413] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/0e571dbc-acb4-45ac-5849-5068a76410c6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e35565325cbd4852a9cb55a0d4477eee, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 22:01:44,601 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegion(2947): Finished flush of dataSize ~56.66 KB/58020, heapSize ~67.60 KB/69224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-17 22:01:44,601 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:44,601 DEBUG [M:0;jenkins-hbase9:39413] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:44,603 INFO [M:0;jenkins-hbase9:39413] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:44,603 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:44,604 INFO [M:0;jenkins-hbase9:39413] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39413 2023-02-17 22:01:44,605 DEBUG [M:0;jenkins-hbase9:39413] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,39413,1676671301067 already deleted, retry=false 2023-02-17 22:01:44,757 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:44,757 INFO [M:0;jenkins-hbase9:39413] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,39413,1676671301067; zookeeper connection closed. 2023-02-17 22:01:44,757 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e9af8bb rejected from java.util.concurrent.ThreadPoolExecutor@3aa57bb0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,758 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): master:39413-0x100644e95970000, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:44,758 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@272436a4 rejected from java.util.concurrent.ThreadPoolExecutor@3aa57bb0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,857 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:44,857 INFO [RS:1;jenkins-hbase9:37303] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,37303,1676671301149; zookeeper connection closed. 2023-02-17 22:01:44,858 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56854196 rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,858 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:37303-0x100644e95970002, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:44,858 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e5b07ec rejected from java.util.concurrent.ThreadPoolExecutor@3b0b4191[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,858 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c006359] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c006359 2023-02-17 22:01:44,958 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:44,958 INFO [RS:0;jenkins-hbase9:41901] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,41901,1676671301123; zookeeper connection closed. 2023-02-17 22:01:44,958 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27458f98 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,958 DEBUG [Listener at localhost/43831-EventThread] zookeeper.ZKWatcher(600): regionserver:41901-0x100644e95970001, quorum=127.0.0.1:63232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:44,958 ERROR [Listener at localhost/43831-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b819d68 rejected from java.util.concurrent.ThreadPoolExecutor@14da7365[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:44,958 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1167f951] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1167f951 2023-02-17 22:01:44,958 INFO [Listener at localhost/43831] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:44,958 WARN [Listener at localhost/43831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:44,962 INFO [Listener at localhost/43831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:45,069 WARN [BP-1866391511-172.31.2.10-1676671300476 heartbeating to localhost/127.0.0.1:42563] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:45,069 WARN [BP-1866391511-172.31.2.10-1676671300476 heartbeating to localhost/127.0.0.1:42563] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1866391511-172.31.2.10-1676671300476 (Datanode Uuid 470e198a-c281-4d23-a808-8bc701344c29) service to localhost/127.0.0.1:42563 2023-02-17 22:01:45,069 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/dfs/data/data3/current/BP-1866391511-172.31.2.10-1676671300476] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:45,070 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/dfs/data/data4/current/BP-1866391511-172.31.2.10-1676671300476] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:45,071 WARN [Listener at localhost/43831] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:45,077 INFO [Listener at localhost/43831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:45,182 WARN [BP-1866391511-172.31.2.10-1676671300476 heartbeating to localhost/127.0.0.1:42563] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:45,182 WARN [BP-1866391511-172.31.2.10-1676671300476 heartbeating to localhost/127.0.0.1:42563] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1866391511-172.31.2.10-1676671300476 (Datanode Uuid 31aa01f5-94bb-4c21-a1bc-3aac9fc001b4) service to localhost/127.0.0.1:42563 2023-02-17 22:01:45,183 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/dfs/data/data1/current/BP-1866391511-172.31.2.10-1676671300476] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:45,183 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/cluster_226d7b32-fba2-10b9-563e-b811058e9460/dfs/data/data2/current/BP-1866391511-172.31.2.10-1676671300476] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:45,193 INFO [Listener at localhost/43831] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:45,306 INFO [Listener at localhost/43831] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:45,320 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:45,332 INFO [Listener at localhost/43831] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43831 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:42563 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:42563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:42563 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:42563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42563 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:42563 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,39413,1676671301067)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:42563 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=575 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 279), ProcessCount=171 (was 171), AvailableMemoryMB=6591 (was 6690) 2023-02-17 22:01:45,343 INFO [Listener at localhost/43831] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=272, OpenFileDescriptor=575, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=171, AvailableMemoryMB=6592 2023-02-17 22:01:45,353 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/hadoop.log.dir so I do NOT create it in target/test-data/c568bc03-08fe-72be-22b3-344177486252 2023-02-17 22:01:45,353 WARN [Listener at localhost/43831] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 22:01:45,353 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/hadoop.tmp.dir so I do NOT create it in target/test-data/c568bc03-08fe-72be-22b3-344177486252 2023-02-17 22:01:45,353 WARN [Listener at localhost/43831] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97dbccc5-221b-1413-b21c-1cb8534ed07b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 22:01:45,353 DEBUG [Listener at localhost/43831] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d, deleteOnExit=true 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/test.cache.data in system properties and HBase conf 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/hadoop.log.dir in system properties and HBase conf 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 22:01:45,354 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 22:01:45,354 DEBUG [Listener at localhost/43831] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 22:01:45,355 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/nfs.dump.dir in system properties and HBase conf 2023-02-17 22:01:45,356 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/java.io.tmpdir in system properties and HBase conf 2023-02-17 22:01:45,356 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 22:01:45,356 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 22:01:45,356 INFO [Listener at localhost/43831] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 22:01:45,360 WARN [Listener at localhost/43831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:45,360 WARN [Listener at localhost/43831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:45,407 WARN [Listener at localhost/43831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:45,409 INFO [Listener at localhost/43831] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:45,416 INFO [Listener at localhost/43831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/java.io.tmpdir/Jetty_localhost_41465_hdfs____.s1u874/webapp 2023-02-17 22:01:45,512 INFO [Listener at localhost/43831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41465 2023-02-17 22:01:45,517 WARN [Listener at localhost/43831] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 22:01:45,517 WARN [Listener at localhost/43831] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 22:01:45,564 WARN [Listener at localhost/33265] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:45,582 WARN [Listener at localhost/33265] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:45,584 WARN [Listener at localhost/33265] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:45,585 INFO [Listener at localhost/33265] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:45,592 INFO [Listener at localhost/33265] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/java.io.tmpdir/Jetty_localhost_43599_datanode____.6g6y8z/webapp 2023-02-17 22:01:45,699 INFO [Listener at localhost/33265] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43599 2023-02-17 22:01:45,716 WARN [Listener at localhost/37217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:45,732 WARN [Listener at localhost/37217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 22:01:45,735 WARN [Listener at localhost/37217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 22:01:45,736 INFO [Listener at localhost/37217] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 22:01:45,740 INFO [Listener at localhost/37217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/java.io.tmpdir/Jetty_localhost_38885_datanode____viozh3/webapp 2023-02-17 22:01:45,822 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xad769c7b52b71ae8: Processing first storage report for DS-87a22ecd-f3f9-4d51-b5d7-127934933312 from datanode f466f7d3-b45f-4028-9462-4400e980a01e 2023-02-17 22:01:45,822 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xad769c7b52b71ae8: from storage DS-87a22ecd-f3f9-4d51-b5d7-127934933312 node DatanodeRegistration(127.0.0.1:43039, datanodeUuid=f466f7d3-b45f-4028-9462-4400e980a01e, infoPort=42009, infoSecurePort=0, ipcPort=37217, storageInfo=lv=-57;cid=testClusterID;nsid=36876699;c=1676671305362), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:45,822 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xad769c7b52b71ae8: Processing first storage report for DS-256f2301-ec99-4116-b2b4-e54041d82c09 from datanode f466f7d3-b45f-4028-9462-4400e980a01e 2023-02-17 22:01:45,822 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xad769c7b52b71ae8: from storage DS-256f2301-ec99-4116-b2b4-e54041d82c09 node DatanodeRegistration(127.0.0.1:43039, datanodeUuid=f466f7d3-b45f-4028-9462-4400e980a01e, infoPort=42009, infoSecurePort=0, ipcPort=37217, storageInfo=lv=-57;cid=testClusterID;nsid=36876699;c=1676671305362), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:45,836 INFO [Listener at localhost/37217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38885 2023-02-17 22:01:45,845 WARN [Listener at localhost/46875] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 22:01:45,933 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4f9a38f8f186533: Processing first storage report for DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7 from datanode 89ea6fc3-d6f2-4f91-82b1-7ae7b97e7df6 2023-02-17 22:01:45,933 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4f9a38f8f186533: from storage DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7 node DatanodeRegistration(127.0.0.1:40267, datanodeUuid=89ea6fc3-d6f2-4f91-82b1-7ae7b97e7df6, infoPort=39477, infoSecurePort=0, ipcPort=46875, storageInfo=lv=-57;cid=testClusterID;nsid=36876699;c=1676671305362), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:45,933 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4f9a38f8f186533: Processing first storage report for DS-312e4d9a-007f-4c37-80b5-428cff551813 from datanode 89ea6fc3-d6f2-4f91-82b1-7ae7b97e7df6 2023-02-17 22:01:45,933 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4f9a38f8f186533: from storage DS-312e4d9a-007f-4c37-80b5-428cff551813 node DatanodeRegistration(127.0.0.1:40267, datanodeUuid=89ea6fc3-d6f2-4f91-82b1-7ae7b97e7df6, infoPort=39477, infoSecurePort=0, ipcPort=46875, storageInfo=lv=-57;cid=testClusterID;nsid=36876699;c=1676671305362), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 22:01:45,955 DEBUG [Listener at localhost/46875] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252 2023-02-17 22:01:45,957 INFO [Listener at localhost/46875] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/zookeeper_0, clientPort=58002, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 22:01:45,958 INFO [Listener at localhost/46875] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58002 2023-02-17 22:01:45,958 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:45,959 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:45,969 INFO [Listener at localhost/46875] util.FSUtils(479): Created version file at hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db with version=8 2023-02-17 22:01:45,969 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:45,970 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:45,971 INFO [Listener at localhost/46875] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/hbase-staging 2023-02-17 22:01:45,972 INFO [Listener at localhost/46875] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:45,972 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:45,972 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:45,973 INFO [Listener at localhost/46875] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:45,973 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:45,973 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:45,973 INFO [Listener at localhost/46875] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:45,973 INFO [Listener at localhost/46875] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36647 2023-02-17 22:01:45,974 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:45,974 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:45,975 INFO [Listener at localhost/46875] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36647 connecting to ZooKeeper ensemble=127.0.0.1:58002 2023-02-17 22:01:45,982 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:366470x0, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:45,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36647-0x100644ea8d30000 connected 2023-02-17 22:01:45,996 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:45,997 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:45,997 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:45,998 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36647 2023-02-17 22:01:45,998 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36647 2023-02-17 22:01:45,999 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36647 2023-02-17 22:01:45,999 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36647 2023-02-17 22:01:45,999 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36647 2023-02-17 22:01:46,000 INFO [Listener at localhost/46875] master.HMaster(444): hbase.rootdir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db, hbase.cluster.distributed=false 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:46,012 INFO [Listener at localhost/46875] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:46,013 INFO [Listener at localhost/46875] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45649 2023-02-17 22:01:46,013 INFO [Listener at localhost/46875] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:46,013 DEBUG [Listener at localhost/46875] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:46,014 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:46,015 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:46,016 INFO [Listener at localhost/46875] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45649 connecting to ZooKeeper ensemble=127.0.0.1:58002 2023-02-17 22:01:46,019 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:456490x0, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:46,019 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): regionserver:456490x0, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:46,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45649-0x100644ea8d30001 connected 2023-02-17 22:01:46,023 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:46,023 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:46,028 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45649 2023-02-17 22:01:46,028 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45649 2023-02-17 22:01:46,028 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45649 2023-02-17 22:01:46,028 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45649 2023-02-17 22:01:46,029 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45649 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 22:01:46,041 INFO [Listener at localhost/46875] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 22:01:46,042 INFO [Listener at localhost/46875] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46317 2023-02-17 22:01:46,042 INFO [Listener at localhost/46875] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 22:01:46,043 DEBUG [Listener at localhost/46875] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:46,043 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:46,044 INFO [Listener at localhost/46875] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:46,045 INFO [Listener at localhost/46875] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46317 connecting to ZooKeeper ensemble=127.0.0.1:58002 2023-02-17 22:01:46,048 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:463170x0, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 22:01:46,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46317-0x100644ea8d30002 connected 2023-02-17 22:01:46,049 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:46,050 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:46,050 DEBUG [Listener at localhost/46875] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 22:01:46,050 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46317 2023-02-17 22:01:46,051 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46317 2023-02-17 22:01:46,051 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46317 2023-02-17 22:01:46,051 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46317 2023-02-17 22:01:46,051 DEBUG [Listener at localhost/46875] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46317 2023-02-17 22:01:46,056 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,058 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,059 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:46,060 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:46,060 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:46,060 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,061 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:46,061 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,36647,1676671305972 from backup master directory 2023-02-17 22:01:46,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 22:01:46,063 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,063 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 22:01:46,063 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:46,063 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,064 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:46,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/hbase.id with ID: 3c211a81-dc6c-4787-9e65-c0581d2978db 2023-02-17 22:01:46,085 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 22:01:46,087 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,093 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2f9992c5 to 127.0.0.1:58002 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:46,097 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62630f24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:46,097 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:46,098 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 22:01:46,098 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:46,099 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store-tmp 2023-02-17 22:01:46,105 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:46,105 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:46,105 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:46,105 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:46,105 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:46,105 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:46,105 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:46,105 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:46,106 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/WALs/jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,107 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36647%2C1676671305972, suffix=, logDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/WALs/jenkins-hbase9.apache.org,36647,1676671305972, archiveDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/oldWALs, maxLogs=10 2023-02-17 22:01:46,119 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK] 2023-02-17 22:01:46,120 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK] 2023-02-17 22:01:46,121 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/WALs/jenkins-hbase9.apache.org,36647,1676671305972/jenkins-hbase9.apache.org%2C36647%2C1676671305972.1676671306107 2023-02-17 22:01:46,121 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK], DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK]] 2023-02-17 22:01:46,121 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:46,121 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:46,122 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:46,122 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:46,123 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:46,123 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 22:01:46,124 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 22:01:46,124 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,125 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:46,125 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:46,127 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 22:01:46,128 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:46,128 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69889971, jitterRate=0.041441723704338074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:46,128 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:46,129 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 22:01:46,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 22:01:46,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 22:01:46,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 22:01:46,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 22:01:46,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 22:01:46,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 22:01:46,131 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 22:01:46,132 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 22:01:46,142 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 22:01:46,142 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 22:01:46,142 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 22:01:46,142 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 22:01:46,142 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 22:01:46,144 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,145 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 22:01:46,145 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 22:01:46,145 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 22:01:46,147 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:46,147 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:46,147 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,147 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:46,148 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,36647,1676671305972, sessionid=0x100644ea8d30000, setting cluster-up flag (Was=false) 2023-02-17 22:01:46,157 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,161 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 22:01:46,161 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,165 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 22:01:46,170 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:46,171 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.hbase-snapshot/.tmp 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:46,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676671336174 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 22:01:46,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 22:01:46,174 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:46,174 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 22:01:46,175 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,175 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 22:01:46,175 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 22:01:46,175 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 22:01:46,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 22:01:46,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 22:01:46,176 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671306176,5,FailOnTimeoutGroup] 2023-02-17 22:01:46,176 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:46,176 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671306176,5,FailOnTimeoutGroup] 2023-02-17 22:01:46,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 22:01:46,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,182 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:46,183 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:46,183 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db 2023-02-17 22:01:46,187 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:46,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:46,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/info 2023-02-17 22:01:46,189 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:46,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:46,190 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:46,191 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:46,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:46,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/table 2023-02-17 22:01:46,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:46,192 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,193 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740 2023-02-17 22:01:46,193 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740 2023-02-17 22:01:46,194 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:46,195 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:46,197 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:46,197 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62715959, jitterRate=-0.06545938551425934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:46,197 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:46,197 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:46,197 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:46,197 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:46,197 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:46,197 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:46,197 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:46,198 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:46,198 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 22:01:46,198 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 22:01:46,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 22:01:46,201 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 22:01:46,202 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 22:01:46,256 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(952): ClusterId : 3c211a81-dc6c-4787-9e65-c0581d2978db 2023-02-17 22:01:46,256 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(952): ClusterId : 3c211a81-dc6c-4787-9e65-c0581d2978db 2023-02-17 22:01:46,256 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:46,256 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 22:01:46,260 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:46,260 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:46,260 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 22:01:46,260 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 22:01:46,263 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:46,264 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 22:01:46,265 DEBUG [RS:1;jenkins-hbase9:46317] zookeeper.ReadOnlyZKClient(139): Connect 0x00d2a2eb to 127.0.0.1:58002 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:46,265 DEBUG [RS:0;jenkins-hbase9:45649] zookeeper.ReadOnlyZKClient(139): Connect 0x4b5e4b92 to 127.0.0.1:58002 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:46,270 DEBUG [RS:0;jenkins-hbase9:45649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4599ac89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:46,270 DEBUG [RS:1;jenkins-hbase9:46317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e155c81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:46,271 DEBUG [RS:0;jenkins-hbase9:45649] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41a620e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:46,271 DEBUG [RS:1;jenkins-hbase9:46317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a2ac99b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:46,280 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:46317 2023-02-17 22:01:46,280 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:45649 2023-02-17 22:01:46,280 INFO [RS:1;jenkins-hbase9:46317] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:46,280 INFO [RS:1;jenkins-hbase9:46317] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:46,280 INFO [RS:0;jenkins-hbase9:45649] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 22:01:46,280 INFO [RS:0;jenkins-hbase9:45649] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 22:01:46,280 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:46,280 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 22:01:46,281 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,36647,1676671305972 with isa=jenkins-hbase9.apache.org/172.31.2.10:45649, startcode=1676671306011 2023-02-17 22:01:46,281 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,36647,1676671305972 with isa=jenkins-hbase9.apache.org/172.31.2.10:46317, startcode=1676671306040 2023-02-17 22:01:46,281 DEBUG [RS:0;jenkins-hbase9:45649] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:46,281 DEBUG [RS:1;jenkins-hbase9:46317] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 22:01:46,285 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57885, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:46,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,288 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41397, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 22:01:46,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,289 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db 2023-02-17 22:01:46,289 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33265 2023-02-17 22:01:46,289 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:46,290 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:46,290 DEBUG [RS:1;jenkins-hbase9:46317] zookeeper.ZKUtil(162): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,290 WARN [RS:1;jenkins-hbase9:46317] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:46,290 INFO [RS:1;jenkins-hbase9:46317] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:46,290 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,291 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db 2023-02-17 22:01:46,291 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33265 2023-02-17 22:01:46,292 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 22:01:46,292 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46317,1676671306040] 2023-02-17 22:01:46,297 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:46,297 DEBUG [RS:0;jenkins-hbase9:45649] zookeeper.ZKUtil(162): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,297 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45649,1676671306011] 2023-02-17 22:01:46,297 WARN [RS:0;jenkins-hbase9:45649] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 22:01:46,297 INFO [RS:0;jenkins-hbase9:45649] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:46,297 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,301 DEBUG [RS:1;jenkins-hbase9:46317] zookeeper.ZKUtil(162): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,301 DEBUG [RS:1;jenkins-hbase9:46317] zookeeper.ZKUtil(162): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,302 DEBUG [RS:0;jenkins-hbase9:45649] zookeeper.ZKUtil(162): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,302 DEBUG [RS:1;jenkins-hbase9:46317] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:46,302 DEBUG [RS:0;jenkins-hbase9:45649] zookeeper.ZKUtil(162): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,302 INFO [RS:1;jenkins-hbase9:46317] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:46,303 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 22:01:46,303 INFO [RS:0;jenkins-hbase9:45649] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 22:01:46,303 INFO [RS:1;jenkins-hbase9:46317] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:46,304 INFO [RS:1;jenkins-hbase9:46317] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:46,304 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,304 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:46,307 INFO [RS:0;jenkins-hbase9:45649] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 22:01:46,308 INFO [RS:0;jenkins-hbase9:45649] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 22:01:46,308 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,308 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 DEBUG [RS:1;jenkins-hbase9:46317] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 22:01:46,312 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,312 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,312 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,312 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,313 DEBUG [RS:0;jenkins-hbase9:45649] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-17 22:01:46,314 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,314 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,314 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,324 INFO [RS:1;jenkins-hbase9:46317] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:46,324 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46317,1676671306040-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,325 INFO [RS:0;jenkins-hbase9:45649] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 22:01:46,325 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45649,1676671306011-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,334 INFO [RS:1;jenkins-hbase9:46317] regionserver.Replication(203): jenkins-hbase9.apache.org,46317,1676671306040 started 2023-02-17 22:01:46,334 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,46317,1676671306040, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46317, sessionid=0x100644ea8d30002 2023-02-17 22:01:46,334 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:46,334 DEBUG [RS:1;jenkins-hbase9:46317] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,334 DEBUG [RS:1;jenkins-hbase9:46317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46317,1676671306040' 2023-02-17 22:01:46,334 DEBUG [RS:1;jenkins-hbase9:46317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:46,335 INFO [RS:0;jenkins-hbase9:45649] regionserver.Replication(203): jenkins-hbase9.apache.org,45649,1676671306011 started 2023-02-17 22:01:46,335 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,45649,1676671306011, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45649, sessionid=0x100644ea8d30001 2023-02-17 22:01:46,335 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 22:01:46,335 DEBUG [RS:0;jenkins-hbase9:45649] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,335 DEBUG [RS:0;jenkins-hbase9:45649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45649,1676671306011' 2023-02-17 22:01:46,335 DEBUG [RS:1;jenkins-hbase9:46317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:46,335 DEBUG [RS:0;jenkins-hbase9:45649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:46,335 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:46,335 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:46,335 DEBUG [RS:1;jenkins-hbase9:46317] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:46,335 DEBUG [RS:1;jenkins-hbase9:46317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46317,1676671306040' 2023-02-17 22:01:46,335 DEBUG [RS:1;jenkins-hbase9:46317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:46,335 DEBUG [RS:0;jenkins-hbase9:45649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:46,336 DEBUG [RS:1;jenkins-hbase9:46317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45649,1676671306011' 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:46,336 DEBUG [RS:1;jenkins-hbase9:46317] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:46,336 INFO [RS:1;jenkins-hbase9:46317] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:46,336 INFO [RS:1;jenkins-hbase9:46317] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:46,336 DEBUG [RS:0;jenkins-hbase9:45649] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 22:01:46,336 INFO [RS:0;jenkins-hbase9:45649] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 22:01:46,336 INFO [RS:0;jenkins-hbase9:45649] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 22:01:46,352 DEBUG [jenkins-hbase9:36647] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 22:01:46,352 DEBUG [jenkins-hbase9:36647] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:46,354 DEBUG [jenkins-hbase9:36647] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:46,354 DEBUG [jenkins-hbase9:36647] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:46,354 DEBUG [jenkins-hbase9:36647] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:46,354 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45649,1676671306011, state=OPENING 2023-02-17 22:01:46,355 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 22:01:46,356 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,357 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:46,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45649,1676671306011}] 2023-02-17 22:01:46,511 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,511 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:46,513 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40602, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:46,516 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 22:01:46,516 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 22:01:46,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45649%2C1676671306011.meta, suffix=.meta, logDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,45649,1676671306011, archiveDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/oldWALs, maxLogs=32 2023-02-17 22:01:46,532 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK] 2023-02-17 22:01:46,532 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK] 2023-02-17 22:01:46,533 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,45649,1676671306011/jenkins-hbase9.apache.org%2C45649%2C1676671306011.meta.1676671306518.meta 2023-02-17 22:01:46,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK], DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK]] 2023-02-17 22:01:46,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:46,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 22:01:46,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 22:01:46,534 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 22:01:46,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 22:01:46,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:46,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 22:01:46,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 22:01:46,535 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 22:01:46,536 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/info 2023-02-17 22:01:46,536 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/info 2023-02-17 22:01:46,536 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 22:01:46,536 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,536 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 22:01:46,537 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:46,537 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/rep_barrier 2023-02-17 22:01:46,537 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 22:01:46,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 22:01:46,538 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/table 2023-02-17 22:01:46,538 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/table 2023-02-17 22:01:46,539 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 22:01:46,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740 2023-02-17 22:01:46,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740 2023-02-17 22:01:46,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 22:01:46,542 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 22:01:46,543 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60667726, jitterRate=-0.0959804356098175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 22:01:46,543 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 22:01:46,543 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676671306511 2023-02-17 22:01:46,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 22:01:46,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 22:01:46,547 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45649,1676671306011, state=OPEN 2023-02-17 22:01:46,548 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 22:01:46,548 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 22:01:46,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 22:01:46,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45649,1676671306011 in 191 msec 2023-02-17 22:01:46,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 22:01:46,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 351 msec 2023-02-17 22:01:46,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 380 msec 2023-02-17 22:01:46,551 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676671306551, completionTime=-1 2023-02-17 22:01:46,552 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 22:01:46,552 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 22:01:46,554 DEBUG [hconnection-0x18622299-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:46,555 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:46,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 22:01:46,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676671366556 2023-02-17 22:01:46,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676671426556 2023-02-17 22:01:46,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36647,1676671305972-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36647,1676671305972-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36647,1676671305972-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:36647, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 22:01:46,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:46,564 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 22:01:46,565 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 22:01:46,565 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:46,565 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:46,566 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,567 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696 empty. 2023-02-17 22:01:46,567 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 22:01:46,574 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:46,575 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 524b6e4612a54fc02e0feddf00ec2696, NAME => 'hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp 2023-02-17 22:01:46,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:46,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 524b6e4612a54fc02e0feddf00ec2696, disabling compactions & flushes 2023-02-17 22:01:46,587 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. after waiting 0 ms 2023-02-17 22:01:46,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,587 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 524b6e4612a54fc02e0feddf00ec2696: 2023-02-17 22:01:46,590 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:46,591 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671306591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671306591"}]},"ts":"1676671306591"} 2023-02-17 22:01:46,593 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:46,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:46,593 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671306593"}]},"ts":"1676671306593"} 2023-02-17 22:01:46,595 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 22:01:46,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:46,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:46,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:46,598 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:46,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=524b6e4612a54fc02e0feddf00ec2696, ASSIGN}] 2023-02-17 22:01:46,604 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=524b6e4612a54fc02e0feddf00ec2696, ASSIGN 2023-02-17 22:01:46,605 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=524b6e4612a54fc02e0feddf00ec2696, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45649,1676671306011; forceNewPlan=false, retain=false 2023-02-17 22:01:46,755 INFO [jenkins-hbase9:36647] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:46,755 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=524b6e4612a54fc02e0feddf00ec2696, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671306755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671306755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671306755"}]},"ts":"1676671306755"} 2023-02-17 22:01:46,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 524b6e4612a54fc02e0feddf00ec2696, server=jenkins-hbase9.apache.org,45649,1676671306011}] 2023-02-17 22:01:46,912 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,913 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45649%2C1676671306011, suffix=, logDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,45649,1676671306011, archiveDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/oldWALs, maxLogs=32 2023-02-17 22:01:46,926 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK] 2023-02-17 22:01:46,926 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK] 2023-02-17 22:01:46,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,45649,1676671306011/jenkins-hbase9.apache.org%2C45649%2C1676671306011.1676671306913 2023-02-17 22:01:46,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK], DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK]] 2023-02-17 22:01:46,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 524b6e4612a54fc02e0feddf00ec2696, NAME => 'hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:46,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:46,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,930 INFO [StoreOpener-524b6e4612a54fc02e0feddf00ec2696-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,931 DEBUG [StoreOpener-524b6e4612a54fc02e0feddf00ec2696-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/info 2023-02-17 22:01:46,931 DEBUG [StoreOpener-524b6e4612a54fc02e0feddf00ec2696-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/info 2023-02-17 22:01:46,931 INFO [StoreOpener-524b6e4612a54fc02e0feddf00ec2696-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 524b6e4612a54fc02e0feddf00ec2696 columnFamilyName info 2023-02-17 22:01:46,932 INFO [StoreOpener-524b6e4612a54fc02e0feddf00ec2696-1] regionserver.HStore(310): Store=524b6e4612a54fc02e0feddf00ec2696/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:46,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:46,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:46,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 524b6e4612a54fc02e0feddf00ec2696; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64094655, jitterRate=-0.04491521418094635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 22:01:46,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 524b6e4612a54fc02e0feddf00ec2696: 2023-02-17 22:01:46,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696., pid=6, masterSystemTime=1676671306909 2023-02-17 22:01:46,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,938 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:46,938 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=524b6e4612a54fc02e0feddf00ec2696, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:46,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676671306938"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671306938"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671306938"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671306938"}]},"ts":"1676671306938"} 2023-02-17 22:01:46,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 22:01:46,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 524b6e4612a54fc02e0feddf00ec2696, server=jenkins-hbase9.apache.org,45649,1676671306011 in 182 msec 2023-02-17 22:01:46,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 22:01:46,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=524b6e4612a54fc02e0feddf00ec2696, ASSIGN in 343 msec 2023-02-17 22:01:46,942 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:46,943 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671306943"}]},"ts":"1676671306943"} 2023-02-17 22:01:46,944 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 22:01:46,946 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:46,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-17 22:01:46,964 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 22:01:46,966 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:46,966 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:46,969 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 22:01:46,975 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:46,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 22:01:46,980 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 22:01:46,988 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 22:01:46,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-17 22:01:46,994 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 22:01:47,002 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 22:01:47,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.939sec 2023-02-17 22:01:47,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 22:01:47,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 22:01:47,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 22:01:47,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36647,1676671305972-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 22:01:47,002 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36647,1676671305972-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 22:01:47,004 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 22:01:47,056 DEBUG [Listener at localhost/46875] zookeeper.ReadOnlyZKClient(139): Connect 0x2f5c68f4 to 127.0.0.1:58002 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:47,060 DEBUG [Listener at localhost/46875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22708867, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:47,061 DEBUG [hconnection-0x1be2767c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:47,062 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:47,064 INFO [Listener at localhost/46875] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:47,064 DEBUG [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 22:01:47,066 DEBUG [Listener at localhost/46875] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 22:01:47,067 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 22:01:47,068 INFO [Listener at localhost/46875] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 22:01:47,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-17 22:01:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 22:01:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.2.10:55902 deadline: 1676671367068, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 22:01:47,069 INFO [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 22:01:47,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 22:01:47,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 22:01:47,072 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 22:01:47,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 22:01:47,073 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 22:01:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:47,074 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,075 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 empty. 2023-02-17 22:01:47,075 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,075 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 22:01:47,083 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 22:01:47,083 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4aa7df3da66cf05a9286777329c33136, NAME => 'testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp 2023-02-17 22:01:47,090 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:47,090 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4aa7df3da66cf05a9286777329c33136, disabling compactions & flushes 2023-02-17 22:01:47,090 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,090 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,090 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. after waiting 0 ms 2023-02-17 22:01:47,090 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,090 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,090 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:47,091 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 22:01:47,092 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676671307092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671307092"}]},"ts":"1676671307092"} 2023-02-17 22:01:47,093 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 22:01:47,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 22:01:47,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671307094"}]},"ts":"1676671307094"} 2023-02-17 22:01:47,095 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 22:01:47,099 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-02-17 22:01:47,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 22:01:47,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 22:01:47,100 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 22:01:47,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, ASSIGN}] 2023-02-17 22:01:47,100 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, ASSIGN 2023-02-17 22:01:47,101 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46317,1676671306040; forceNewPlan=false, retain=false 2023-02-17 22:01:47,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:47,251 INFO [jenkins-hbase9:36647] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 22:01:47,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4aa7df3da66cf05a9286777329c33136, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676671307252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671307252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671307252"}]},"ts":"1676671307252"} 2023-02-17 22:01:47,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 4aa7df3da66cf05a9286777329c33136, server=jenkins-hbase9.apache.org,46317,1676671306040}] 2023-02-17 22:01:47,338 INFO [RS:1;jenkins-hbase9:46317] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46317%2C1676671306040, suffix=, logDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,46317,1676671306040, archiveDir=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/oldWALs, maxLogs=32 2023-02-17 22:01:47,353 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK] 2023-02-17 22:01:47,353 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK] 2023-02-17 22:01:47,354 INFO [RS:1;jenkins-hbase9:46317] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/WALs/jenkins-hbase9.apache.org,46317,1676671306040/jenkins-hbase9.apache.org%2C46317%2C1676671306040.1676671307338 2023-02-17 22:01:47,356 DEBUG [RS:1;jenkins-hbase9:46317] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43039,DS-87a22ecd-f3f9-4d51-b5d7-127934933312,DISK], DatanodeInfoWithStorage[127.0.0.1:40267,DS-9b7a5fa1-4967-44c5-9c99-235bf4a46ef7,DISK]] 2023-02-17 22:01:47,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:47,406 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,406 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 22:01:47,407 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 22:01:47,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4aa7df3da66cf05a9286777329c33136, NAME => 'testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.', STARTKEY => '', ENDKEY => ''} 2023-02-17 22:01:47,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:47,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,412 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,413 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1 2023-02-17 22:01:47,413 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1 2023-02-17 22:01:47,413 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4aa7df3da66cf05a9286777329c33136 columnFamilyName f1 2023-02-17 22:01:47,414 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(310): Store=4aa7df3da66cf05a9286777329c33136/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:47,414 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,415 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2 2023-02-17 22:01:47,415 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2 2023-02-17 22:01:47,415 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4aa7df3da66cf05a9286777329c33136 columnFamilyName f2 2023-02-17 22:01:47,415 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(310): Store=4aa7df3da66cf05a9286777329c33136/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:47,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:47,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:47,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 22:01:47,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 4aa7df3da66cf05a9286777329c33136; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62599343, jitterRate=-0.06719709932804108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:47,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:47,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136., pid=12, masterSystemTime=1676671307406 2023-02-17 22:01:47,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4aa7df3da66cf05a9286777329c33136, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676671307427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676671307427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676671307427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676671307427"}]},"ts":"1676671307427"} 2023-02-17 22:01:47,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 22:01:47,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 4aa7df3da66cf05a9286777329c33136, server=jenkins-hbase9.apache.org,46317,1676671306040 in 176 msec 2023-02-17 22:01:47,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 22:01:47,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, ASSIGN in 331 msec 2023-02-17 22:01:47,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 22:01:47,433 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671307433"}]},"ts":"1676671307433"} 2023-02-17 22:01:47,435 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 22:01:47,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 22:01:47,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 368 msec 2023-02-17 22:01:47,583 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 22:01:47,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 22:01:47,678 INFO [Listener at localhost/46875] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 22:01:47,678 DEBUG [Listener at localhost/46875] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 22:01:47,678 INFO [Listener at localhost/46875] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:47,680 INFO [Listener at localhost/46875] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 22:01:47,681 INFO [Listener at localhost/46875] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 22:01:47,681 INFO [Listener at localhost/46875] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 22:01:47,681 INFO [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 22:01:47,793 DEBUG [hconnection-0x1be2767c-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:47,807 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:47,817 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46317] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,902 INFO [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 22:01:47,902 INFO [Listener at localhost/46875] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 22:01:47,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:47,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676671307903 (current time:1676671307903). 2023-02-17 22:01:47,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 22:01:47,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] zookeeper.ReadOnlyZKClient(139): Connect 0x024aee54 to 127.0.0.1:58002 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 22:01:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c4f4417, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 22:01:47,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 22:01:47,908 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 22:01:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x024aee54 to 127.0.0.1:58002 2023-02-17 22:01:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 22:01:47,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:47,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:47,913 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:47,913 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676671907913 2023-02-17 22:01:47,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 22:01:47,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 22:01:47,915 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:47,915 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 22:01:47,915 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 22:01:47,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:47,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-17 22:01:47,916 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:47,917 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676671907917 2023-02-17 22:01:47,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-17 22:01:47,927 INFO [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-17 22:01:47,927 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:47,928 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-17 22:01:47,928 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 22:01:47,928 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:47,928 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:47,930 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:47,930 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:47,930 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:47,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:47,930 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,930 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-17 22:01:47,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-17 22:01:47,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-17 22:01:47,932 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-17 22:01:47,932 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:47,933 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 22:01:47,933 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-17 22:01:47,933 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-17 22:01:47,933 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 22:01:47,933 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46317,1676671306040' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-17 22:01:47,935 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 22:01:47,936 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-17 22:01:47,936 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45649,1676671306011' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-17 22:01:47,938 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:47,939 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:47,939 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,939 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:47,939 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 22:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,941 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,941 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:47,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:47,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:47,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46317,1676671306040' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-17 22:01:47,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c49469[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:47,942 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 22:01:47,942 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 22:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:47,944 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 22:01:47,944 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 22:01:47,944 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:47,944 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. started... 2023-02-17 22:01:47,944 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:47,944 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:47,945 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4aa7df3da66cf05a9286777329c33136 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 22:01:47,945 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 22:01:47,945 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-17 22:01:47,945 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,45649,1676671306011' in zk 2023-02-17 22:01:47,948 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-17 22:01:47,948 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:47,948 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-17 22:01:47,969 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f1/4351c36b23f7429e912e96c7a9233a1e 2023-02-17 22:01:48,001 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f2/416e8347fc6f49b09e77a70a02a66f59 2023-02-17 22:01:48,007 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f1/4351c36b23f7429e912e96c7a9233a1e as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/4351c36b23f7429e912e96c7a9233a1e 2023-02-17 22:01:48,014 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/4351c36b23f7429e912e96c7a9233a1e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:48,015 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f2/416e8347fc6f49b09e77a70a02a66f59 as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/416e8347fc6f49b09e77a70a02a66f59 2023-02-17 22:01:48,015 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:48,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:48,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 22:01:48,016 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 22:01:48,021 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/416e8347fc6f49b09e77a70a02a66f59, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 22:01:48,021 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 4aa7df3da66cf05a9286777329c33136 in 77ms, sequenceid=5, compaction requested=false 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/4351c36b23f7429e912e96c7a9233a1e] hfiles 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/4351c36b23f7429e912e96c7a9233a1e for snapshot=testWithMapReduceSingleRegion 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/416e8347fc6f49b09e77a70a02a66f59] hfiles 2023-02-17 22:01:48,022 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/416e8347fc6f49b09e77a70a02a66f59 for snapshot=testWithMapReduceSingleRegion 2023-02-17 22:01:48,033 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. completed. 2023-02-17 22:01:48,033 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,033 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 22:01:48,033 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 22:01:48,033 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,033 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-17 22:01:48,033 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase9.apache.org,46317,1676671306040' in zk 2023-02-17 22:01:48,035 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,035 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-17 22:01:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:48,035 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:48,035 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-17 22:01:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 22:01:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 22:01:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase9.apache.org,46317,1676671306040': 2023-02-17 22:01:48,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46317,1676671306040' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 22:01:48,038 INFO [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-17 22:01:48,038 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:48,038 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:48,038 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-17 22:01:48,038 INFO [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 22:01:48,040 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 22:01:48,040 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:48,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:48,041 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,041 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 22:01:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 22:01:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,043 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:48,043 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 22:01:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:48,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:48,050 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 22:01:48,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-17 22:01:48,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:48,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 22:01:48,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 22:01:48,050 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 22:01:48,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:48,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:48,051 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:48,051 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 22:01:48,051 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 22:01:48,051 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 22:01:48,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 22:01:48,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 22:01:48,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-17 22:01:48,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-17 22:01:48,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 22:01:48,079 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 22:01:48,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676671307913Consolidate snapshot: testWithMapReduceSingleRegion at 1676671308050 (+137 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676671308050Writing data manifest for testWithMapReduceSingleRegion at 1676671308053 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676671308059 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676671308079 (+20 ms) 2023-02-17 22:01:48,082 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 22:01:48,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 168 msec 2023-02-17 22:01:48,216 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 22:01:48,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 22:01:48,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 22:01:48,218 INFO [Listener at localhost/46875] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 22:01:48,221 INFO [Listener at localhost/46875] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 22:01:48,225 INFO [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 22:01:48,251 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46317] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,335 INFO [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 22:01:48,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-17 22:01:48,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 22:01:48,341 INFO [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 22:01:48,341 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:48,341 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 22:01:48,341 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 22:01:48,341 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,341 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,343 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:48,343 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:48,343 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:48,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:48,344 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,344 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 22:01:48,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 22:01:48,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 22:01:48,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45649,1676671306011' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 22:01:48,345 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 22:01:48,345 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,345 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. started... 2023-02-17 22:01:48,345 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4aa7df3da66cf05a9286777329c33136 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 22:01:48,346 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,346 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,346 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:48,359 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f1/d606114ebbb34f418aca34d3c1233ba4 2023-02-17 22:01:48,377 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f2/36331eb23a0f4e8c952208c3beea60f2 2023-02-17 22:01:48,380 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f1/d606114ebbb34f418aca34d3c1233ba4 as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/d606114ebbb34f418aca34d3c1233ba4 2023-02-17 22:01:48,384 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/d606114ebbb34f418aca34d3c1233ba4, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:48,385 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/.tmp/f2/36331eb23a0f4e8c952208c3beea60f2 as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/36331eb23a0f4e8c952208c3beea60f2 2023-02-17 22:01:48,388 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/36331eb23a0f4e8c952208c3beea60f2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 22:01:48,389 INFO [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 4aa7df3da66cf05a9286777329c33136 in 44ms, sequenceid=9, compaction requested=false 2023-02-17 22:01:48,389 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:48,389 DEBUG [rs(jenkins-hbase9.apache.org,46317,1676671306040)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,389 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 22:01:48,389 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 22:01:48,389 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,389 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 22:01:48,389 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46317,1676671306040' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 22:01:48,390 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,390 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:48,391 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,391 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 22:01:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:48,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:48,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46317,1676671306040' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 22:01:48,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21fb0409[Count = 0] remaining members to acquire global barrier 2023-02-17 22:01:48,392 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 22:01:48,392 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,393 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,394 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,394 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,394 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 22:01:48,394 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 22:01:48,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,394 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,46317,1676671306040' in zk 2023-02-17 22:01:48,394 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 22:01:48,394 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 22:01:48,394 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase9.apache.org,45649,1676671306011' in zk 2023-02-17 22:01:48,394 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 22:01:48,396 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 22:01:48,396 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:48,396 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,396 DEBUG [member: 'jenkins-hbase9.apache.org,45649,1676671306011' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 22:01:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:48,396 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 22:01:48,397 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:48,397 DEBUG [member: 'jenkins-hbase9.apache.org,46317,1676671306040' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 22:01:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase9.apache.org,46317,1676671306040': 2023-02-17 22:01:48,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46317,1676671306040' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 22:01:48,399 INFO [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 22:01:48,399 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 22:01:48,399 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 22:01:48,399 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 22:01:48,399 INFO [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 22:01:48,401 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:48,401 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:48,401 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 22:01:48,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 22:01:48,401 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:48,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:48,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 22:01:48,402 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:48,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 22:01:48,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:48,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,403 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,403 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 22:01:48,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 22:01:48,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:48,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:48,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 22:01:48,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 22:01:48,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:48,406 DEBUG [(jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 22:01:48,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 22:01:48,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 22:01:48,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:48,406 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:48,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 22:01:48,407 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,407 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:48,407 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 22:01:48,407 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 22:01:48,506 DEBUG [Listener at localhost/46875] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 22:01:48,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 22:01:48,614 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/hadoop-924351728614147850.jar 2023-02-17 22:01:48,618 INFO [Listener at localhost/46875] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676671307903 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:48,618 DEBUG [Listener at localhost/46875] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df/data/default/testWithMapReduce 2023-02-17 22:01:48,619 INFO [Listener at localhost/46875] snapshot.RestoreSnapshotHelper(239): region to add: 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:48,619 INFO [Listener at localhost/46875] snapshot.RestoreSnapshotHelper(585): clone region=4aa7df3da66cf05a9286777329c33136 as 4aa7df3da66cf05a9286777329c33136 in snapshot testWithMapReduceSingleRegion 2023-02-17 22:01:48,619 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4aa7df3da66cf05a9286777329c33136, NAME => 'testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df 2023-02-17 22:01:48,629 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:48,629 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4351c36b23f7429e912e96c7a9233a1e from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-17 22:01:48,631 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 416e8347fc6f49b09e77a70a02a66f59 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-17 22:01:48,633 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4aa7df3da66cf05a9286777329c33136, disabling compactions & flushes 2023-02-17 22:01:48,633 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,633 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,633 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. after waiting 0 ms 2023-02-17 22:01:48,633 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,633 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:48,633 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:48,634 INFO [Listener at localhost/46875] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676671307903 type: FLUSH version: 2 ttl: 0 2023-02-17 22:01:48,634 DEBUG [Listener at localhost/46875] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df 2023-02-17 22:01:48,634 DEBUG [Listener at localhost/46875] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df 2023-02-17 22:01:48,634 DEBUG [Listener at localhost/46875] util.CommonFSUtils(699): |-data/ 2023-02-17 22:01:48,635 DEBUG [Listener at localhost/46875] util.CommonFSUtils(699): |----default/ 2023-02-17 22:01:48,635 DEBUG [Listener at localhost/46875] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 22:01:48,636 DEBUG [Listener at localhost/46875] util.CommonFSUtils(699): |----------4aa7df3da66cf05a9286777329c33136/ 2023-02-17 22:01:48,636 DEBUG [Listener at localhost/46875] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 22:01:48,636 DEBUG [Listener at localhost/46875] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 22:01:48,638 DEBUG [Listener at localhost/46875] util.CommonFSUtils(702): |----------------testWithMapReduce=4aa7df3da66cf05a9286777329c33136-4351c36b23f7429e912e96c7a9233a1e 2023-02-17 22:01:48,638 DEBUG [Listener at localhost/46875] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 22:01:48,639 DEBUG [Listener at localhost/46875] util.CommonFSUtils(702): |----------------testWithMapReduce=4aa7df3da66cf05a9286777329c33136-416e8347fc6f49b09e77a70a02a66f59 2023-02-17 22:01:48,639 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:48,640 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:48,640 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:48,641 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,549 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/hadoop-7116205672011515408.jar 2023-02-17 22:01:49,550 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,551 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,619 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/hadoop-2315742349163263889.jar 2023-02-17 22:01:49,620 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,620 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,621 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,621 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,621 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,622 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,622 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 22:01:49,622 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 22:01:49,623 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 22:01:49,623 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 22:01:49,623 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 22:01:49,624 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 22:01:49,624 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 22:01:49,625 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 22:01:49,625 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 22:01:49,625 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 22:01:49,626 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 22:01:49,626 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:49,627 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:49,627 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 22:01:49,627 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 22:01:49,695 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/hadoop-116241406657978475.jar 2023-02-17 22:01:49,695 DEBUG [Listener at localhost/46875] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 22:01:49,701 WARN [Listener at localhost/46875] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 22:01:49,707 WARN [Listener at localhost/46875] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-17 22:01:49,714 INFO [Listener at localhost/46875] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 22:01:49,839 WARN [Listener at localhost/46875] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/mapreduce.cluster.local.dir/1676671309769/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 22:01:49,839 WARN [Listener at localhost/46875] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/mapreduce.cluster.local.dir/1676671309769/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 22:01:49,888 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 22:01:49,888 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 22:01:49,890 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 22:01:49,895 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:49,896 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1 2023-02-17 22:01:49,896 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4aa7df3da66cf05a9286777329c33136 columnFamilyName f1 2023-02-17 22:01:49,902 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(539): loaded hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/testWithMapReduce=4aa7df3da66cf05a9286777329c33136-4351c36b23f7429e912e96c7a9233a1e 2023-02-17 22:01:49,902 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(310): Store=4aa7df3da66cf05a9286777329c33136/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:49,902 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:49,903 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2 2023-02-17 22:01:49,904 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4aa7df3da66cf05a9286777329c33136 columnFamilyName f2 2023-02-17 22:01:49,908 DEBUG [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(539): loaded hdfs://localhost:33265/user/jenkins/test-data/cc904a13-ff7f-73e1-55ab-00f7f478342e/testWithMapReduceSingleRegion/f2a7f731-5e24-4375-9828-dc39259147df/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/testWithMapReduce=4aa7df3da66cf05a9286777329c33136-416e8347fc6f49b09e77a70a02a66f59 2023-02-17 22:01:49,908 INFO [StoreOpener-4aa7df3da66cf05a9286777329c33136-1] regionserver.HStore(310): Store=4aa7df3da66cf05a9286777329c33136/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 22:01:49,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 22:01:49,909 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4aa7df3da66cf05a9286777329c33136; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74101782, jitterRate=0.10420259833335876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 22:01:49,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:50,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4aa7df3da66cf05a9286777329c33136, disabling compactions & flushes 2023-02-17 22:01:50,056 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:50,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:50,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. after waiting 0 ms 2023-02-17 22:01:50,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:50,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:50,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:50,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "testWithMapReduceSingleRegion" 2023-02-17 22:01:50,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-17 22:01:50,892 INFO [Listener at localhost/46875] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 22:01:50,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testWithMapReduce 2023-02-17 22:01:50,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-17 22:01:50,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:50,895 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671310895"}]},"ts":"1676671310895"} 2023-02-17 22:01:50,896 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-17 22:01:50,898 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-17 22:01:50,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, UNASSIGN}] 2023-02-17 22:01:50,899 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, UNASSIGN 2023-02-17 22:01:50,899 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4aa7df3da66cf05a9286777329c33136, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:50,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676671310899"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676671310899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676671310899"}]},"ts":"1676671310899"} 2023-02-17 22:01:50,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 4aa7df3da66cf05a9286777329c33136, server=jenkins-hbase9.apache.org,46317,1676671306040}] 2023-02-17 22:01:50,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:51,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:51,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 4aa7df3da66cf05a9286777329c33136, disabling compactions & flushes 2023-02-17 22:01:51,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:51,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:51,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. after waiting 0 ms 2023-02-17 22:01:51,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:51,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 22:01:51,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136. 2023-02-17 22:01:51,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 4aa7df3da66cf05a9286777329c33136: 2023-02-17 22:01:51,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:51,060 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4aa7df3da66cf05a9286777329c33136, regionState=CLOSED 2023-02-17 22:01:51,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676671311060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676671311060"}]},"ts":"1676671311060"} 2023-02-17 22:01:51,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 22:01:51,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 4aa7df3da66cf05a9286777329c33136, server=jenkins-hbase9.apache.org,46317,1676671306040 in 161 msec 2023-02-17 22:01:51,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 22:01:51,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4aa7df3da66cf05a9286777329c33136, UNASSIGN in 165 msec 2023-02-17 22:01:51,064 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676671311064"}]},"ts":"1676671311064"} 2023-02-17 22:01:51,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-17 22:01:51,068 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-17 22:01:51,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 176 msec 2023-02-17 22:01:51,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 22:01:51,198 INFO [Listener at localhost/46875] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-17 22:01:51,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testWithMapReduce 2023-02-17 22:01:51,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:51,201 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:51,202 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:51,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:51,205 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:51,206 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1, FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2, FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/recovered.edits] 2023-02-17 22:01:51,210 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/4351c36b23f7429e912e96c7a9233a1e to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/archive/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/4351c36b23f7429e912e96c7a9233a1e 2023-02-17 22:01:51,211 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/d606114ebbb34f418aca34d3c1233ba4 to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/archive/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f1/d606114ebbb34f418aca34d3c1233ba4 2023-02-17 22:01:51,214 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/36331eb23a0f4e8c952208c3beea60f2 to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/archive/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/36331eb23a0f4e8c952208c3beea60f2 2023-02-17 22:01:51,215 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/416e8347fc6f49b09e77a70a02a66f59 to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/archive/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/f2/416e8347fc6f49b09e77a70a02a66f59 2023-02-17 22:01:51,217 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/recovered.edits/12.seqid to hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/archive/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136/recovered.edits/12.seqid 2023-02-17 22:01:51,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/.tmp/data/default/testWithMapReduce/4aa7df3da66cf05a9286777329c33136 2023-02-17 22:01:51,218 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 22:01:51,220 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:51,223 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-17 22:01:51,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-17 22:01:51,225 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:51,225 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-17 22:01:51,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676671311225"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:51,226 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 22:01:51,226 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4aa7df3da66cf05a9286777329c33136, NAME => 'testWithMapReduce,,1676671307070.4aa7df3da66cf05a9286777329c33136.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 22:01:51,226 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-17 22:01:51,226 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676671311226"}]},"ts":"9223372036854775807"} 2023-02-17 22:01:51,228 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-17 22:01:51,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 22:01:51,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 30 msec 2023-02-17 22:01:51,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36647] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 22:01:51,303 INFO [Listener at localhost/46875] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-17 22:01:51,303 INFO [Listener at localhost/46875] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 22:01:51,303 INFO [Listener at localhost/46875] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 22:01:51,304 DEBUG [Listener at localhost/46875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f5c68f4 to 127.0.0.1:58002 2023-02-17 22:01:51,304 DEBUG [Listener at localhost/46875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,304 DEBUG [Listener at localhost/46875] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 22:01:51,304 DEBUG [Listener at localhost/46875] util.JVMClusterUtil(257): Found active master hash=2054224591, stopped=false 2023-02-17 22:01:51,304 INFO [Listener at localhost/46875] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:51,306 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:51,306 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:51,306 INFO [Listener at localhost/46875] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 22:01:51,306 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 22:01:51,306 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:51,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:51,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:51,307 DEBUG [Listener at localhost/46875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f9992c5 to 127.0.0.1:58002 2023-02-17 22:01:51,307 DEBUG [Listener at localhost/46875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 22:01:51,307 INFO [Listener at localhost/46875] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,45649,1676671306011' ***** 2023-02-17 22:01:51,308 INFO [Listener at localhost/46875] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:51,308 INFO [Listener at localhost/46875] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,46317,1676671306040' ***** 2023-02-17 22:01:51,308 INFO [Listener at localhost/46875] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 22:01:51,308 INFO [RS:0;jenkins-hbase9:45649] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:51,308 INFO [RS:1;jenkins-hbase9:46317] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 22:01:51,308 INFO [RS:0;jenkins-hbase9:45649] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:51,308 INFO [RS:1;jenkins-hbase9:46317] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 22:01:51,308 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:51,308 INFO [RS:1;jenkins-hbase9:46317] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:51,308 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 22:01:51,309 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:51,308 INFO [RS:0;jenkins-hbase9:45649] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 22:01:51,310 DEBUG [RS:1;jenkins-hbase9:46317] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00d2a2eb to 127.0.0.1:58002 2023-02-17 22:01:51,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(3304): Received CLOSE for 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:51,310 DEBUG [RS:1;jenkins-hbase9:46317] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,310 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,46317,1676671306040; all regions closed. 2023-02-17 22:01:51,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:51,310 DEBUG [RS:0;jenkins-hbase9:45649] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b5e4b92 to 127.0.0.1:58002 2023-02-17 22:01:51,310 DEBUG [RS:0;jenkins-hbase9:45649] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 524b6e4612a54fc02e0feddf00ec2696, disabling compactions & flushes 2023-02-17 22:01:51,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:51,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:51,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:51,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:51,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:51,310 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 22:01:51,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. after waiting 0 ms 2023-02-17 22:01:51,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:51,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 524b6e4612a54fc02e0feddf00ec2696 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 22:01:51,311 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 22:01:51,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 22:01:51,311 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1479): Online Regions={524b6e4612a54fc02e0feddf00ec2696=hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696., 1588230740=hbase:meta,,1.1588230740} 2023-02-17 22:01:51,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 22:01:51,311 DEBUG [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1505): Waiting on 1588230740, 524b6e4612a54fc02e0feddf00ec2696 2023-02-17 22:01:51,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 22:01:51,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 22:01:51,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 22:01:51,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-17 22:01:51,313 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 22:01:51,313 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 22:01:51,314 DEBUG [RS:1;jenkins-hbase9:46317] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/oldWALs 2023-02-17 22:01:51,314 INFO [RS:1;jenkins-hbase9:46317] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46317%2C1676671306040:(num 1676671307338) 2023-02-17 22:01:51,314 DEBUG [RS:1;jenkins-hbase9:46317] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,314 INFO [RS:1;jenkins-hbase9:46317] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:51,314 INFO [RS:1;jenkins-hbase9:46317] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:51,314 INFO [RS:1;jenkins-hbase9:46317] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 22:01:51,314 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:51,314 INFO [RS:1;jenkins-hbase9:46317] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 22:01:51,314 INFO [RS:1;jenkins-hbase9:46317] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 22:01:51,315 INFO [RS:1;jenkins-hbase9:46317] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46317 2023-02-17 22:01:51,317 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:51,317 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46317,1676671306040 2023-02-17 22:01:51,317 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:51,317 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:51,317 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:51,317 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2afe988e rejected from java.util.concurrent.ThreadPoolExecutor@2ec11909[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,317 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46317,1676671306040] 2023-02-17 22:01:51,317 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46317,1676671306040; numProcessing=1 2023-02-17 22:01:51,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/.tmp/info/f0b3292687fe4bbdbc0e8074bd477449 2023-02-17 22:01:51,320 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46317,1676671306040 already deleted, retry=false 2023-02-17 22:01:51,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/.tmp/info/588a411e193545799e4216c38ad5a6eb 2023-02-17 22:01:51,320 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46317,1676671306040 expired; onlineServers=1 2023-02-17 22:01:51,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 588a411e193545799e4216c38ad5a6eb 2023-02-17 22:01:51,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/.tmp/info/f0b3292687fe4bbdbc0e8074bd477449 as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/info/f0b3292687fe4bbdbc0e8074bd477449 2023-02-17 22:01:51,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/info/f0b3292687fe4bbdbc0e8074bd477449, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 22:01:51,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 524b6e4612a54fc02e0feddf00ec2696 in 19ms, sequenceid=6, compaction requested=false 2023-02-17 22:01:51,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/.tmp/rep_barrier/20758b41169a461497607cdd73e82637 2023-02-17 22:01:51,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/namespace/524b6e4612a54fc02e0feddf00ec2696/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 22:01:51,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:51,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 524b6e4612a54fc02e0feddf00ec2696: 2023-02-17 22:01:51,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676671306563.524b6e4612a54fc02e0feddf00ec2696. 2023-02-17 22:01:51,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20758b41169a461497607cdd73e82637 2023-02-17 22:01:51,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/.tmp/table/1f613d990220407d813e1b7d997ebace 2023-02-17 22:01:51,348 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f613d990220407d813e1b7d997ebace 2023-02-17 22:01:51,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/.tmp/info/588a411e193545799e4216c38ad5a6eb as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/info/588a411e193545799e4216c38ad5a6eb 2023-02-17 22:01:51,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 588a411e193545799e4216c38ad5a6eb 2023-02-17 22:01:51,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/info/588a411e193545799e4216c38ad5a6eb, entries=12, sequenceid=21, filesize=6.2 K 2023-02-17 22:01:51,353 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/.tmp/rep_barrier/20758b41169a461497607cdd73e82637 as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/rep_barrier/20758b41169a461497607cdd73e82637 2023-02-17 22:01:51,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20758b41169a461497607cdd73e82637 2023-02-17 22:01:51,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/rep_barrier/20758b41169a461497607cdd73e82637, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 22:01:51,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/.tmp/table/1f613d990220407d813e1b7d997ebace as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/table/1f613d990220407d813e1b7d997ebace 2023-02-17 22:01:51,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f613d990220407d813e1b7d997ebace 2023-02-17 22:01:51,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/table/1f613d990220407d813e1b7d997ebace, entries=4, sequenceid=21, filesize=5.0 K 2023-02-17 22:01:51,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false 2023-02-17 22:01:51,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 22:01:51,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 22:01:51,366 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:51,366 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 22:01:51,366 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 22:01:51,375 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 22:01:51,375 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 22:01:51,377 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:51,377 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:51,419 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:51,419 INFO [RS:1;jenkins-hbase9:46317] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,46317,1676671306040; zookeeper connection closed. 2023-02-17 22:01:51,420 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4068f0e rejected from java.util.concurrent.ThreadPoolExecutor@2ec11909[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,420 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:46317-0x100644ea8d30002, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:51,420 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ccd1eec rejected from java.util.concurrent.ThreadPoolExecutor@2ec11909[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,420 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a0f9b36] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a0f9b36 2023-02-17 22:01:51,511 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,45649,1676671306011; all regions closed. 2023-02-17 22:01:51,514 DEBUG [RS:0;jenkins-hbase9:45649] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/oldWALs 2023-02-17 22:01:51,514 INFO [RS:0;jenkins-hbase9:45649] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45649%2C1676671306011.meta:.meta(num 1676671306518) 2023-02-17 22:01:51,517 DEBUG [RS:0;jenkins-hbase9:45649] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/oldWALs 2023-02-17 22:01:51,517 INFO [RS:0;jenkins-hbase9:45649] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45649%2C1676671306011:(num 1676671306913) 2023-02-17 22:01:51,517 DEBUG [RS:0;jenkins-hbase9:45649] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,517 INFO [RS:0;jenkins-hbase9:45649] regionserver.LeaseManager(133): Closed leases 2023-02-17 22:01:51,517 INFO [RS:0;jenkins-hbase9:45649] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 22:01:51,518 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:51,520 INFO [RS:0;jenkins-hbase9:45649] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45649 2023-02-17 22:01:51,522 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45649,1676671306011 2023-02-17 22:01:51,522 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 22:01:51,522 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@768f3a62 rejected from java.util.concurrent.ThreadPoolExecutor@72b0b06b[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,523 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45649,1676671306011] 2023-02-17 22:01:51,523 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45649,1676671306011; numProcessing=2 2023-02-17 22:01:51,525 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45649,1676671306011 already deleted, retry=false 2023-02-17 22:01:51,525 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45649,1676671306011 expired; onlineServers=0 2023-02-17 22:01:51,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,36647,1676671305972' ***** 2023-02-17 22:01:51,525 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 22:01:51,526 DEBUG [M:0;jenkins-hbase9:36647] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e4f7159, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-17 22:01:51,526 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,36647,1676671305972 2023-02-17 22:01:51,526 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,36647,1676671305972; all regions closed. 2023-02-17 22:01:51,526 DEBUG [M:0;jenkins-hbase9:36647] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 22:01:51,526 DEBUG [M:0;jenkins-hbase9:36647] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 22:01:51,526 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 22:01:51,526 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671306176] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1676671306176,5,FailOnTimeoutGroup] 2023-02-17 22:01:51,526 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671306176] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1676671306176,5,FailOnTimeoutGroup] 2023-02-17 22:01:51,526 DEBUG [M:0;jenkins-hbase9:36647] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 22:01:51,528 INFO [M:0;jenkins-hbase9:36647] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 22:01:51,528 INFO [M:0;jenkins-hbase9:36647] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 22:01:51,528 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 22:01:51,528 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 22:01:51,528 INFO [M:0;jenkins-hbase9:36647] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-17 22:01:51,528 DEBUG [M:0;jenkins-hbase9:36647] master.HMaster(1512): Stopping service threads 2023-02-17 22:01:51,528 INFO [M:0;jenkins-hbase9:36647] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 22:01:51,529 ERROR [M:0;jenkins-hbase9:36647] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 22:01:51,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 22:01:51,529 INFO [M:0;jenkins-hbase9:36647] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 22:01:51,529 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 22:01:51,529 DEBUG [M:0;jenkins-hbase9:36647] zookeeper.ZKUtil(398): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 22:01:51,529 WARN [M:0;jenkins-hbase9:36647] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 22:01:51,529 INFO [M:0;jenkins-hbase9:36647] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 22:01:51,530 INFO [M:0;jenkins-hbase9:36647] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 22:01:51,530 DEBUG [M:0;jenkins-hbase9:36647] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 22:01:51,530 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:51,530 DEBUG [M:0;jenkins-hbase9:36647] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:51,530 DEBUG [M:0;jenkins-hbase9:36647] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 22:01:51,530 DEBUG [M:0;jenkins-hbase9:36647] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:51,530 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.69 KB heapSize=65.67 KB 2023-02-17 22:01:51,540 INFO [M:0;jenkins-hbase9:36647] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ff54c60069344388be3a67ebd55c8017 2023-02-17 22:01:51,544 DEBUG [M:0;jenkins-hbase9:36647] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ff54c60069344388be3a67ebd55c8017 as hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ff54c60069344388be3a67ebd55c8017 2023-02-17 22:01:51,547 INFO [M:0;jenkins-hbase9:36647] regionserver.HStore(1080): Added hdfs://localhost:33265/user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ff54c60069344388be3a67ebd55c8017, entries=17, sequenceid=132, filesize=8.6 K 2023-02-17 22:01:51,548 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegion(2947): Finished flush of dataSize ~54.69 KB/56006, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-17 22:01:51,548 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 22:01:51,548 DEBUG [M:0;jenkins-hbase9:36647] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 22:01:51,550 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/95eba580-c586-4adf-3738-99ad6070e3db/MasterData/WALs/jenkins-hbase9.apache.org,36647,1676671305972/jenkins-hbase9.apache.org%2C36647%2C1676671305972.1676671306107 not finished, retry = 0 2023-02-17 22:01:51,651 INFO [M:0;jenkins-hbase9:36647] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 22:01:51,651 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 22:01:51,652 INFO [M:0;jenkins-hbase9:36647] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36647 2023-02-17 22:01:51,653 DEBUG [M:0;jenkins-hbase9:36647] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,36647,1676671305972 already deleted, retry=false 2023-02-17 22:01:51,806 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:51,806 INFO [M:0;jenkins-hbase9:36647] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,36647,1676671305972; zookeeper connection closed. 2023-02-17 22:01:51,806 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cedca90 rejected from java.util.concurrent.ThreadPoolExecutor@18d24dd5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,808 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): master:36647-0x100644ea8d30000, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:51,808 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e0cdaba rejected from java.util.concurrent.ThreadPoolExecutor@18d24dd5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,907 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:51,907 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@99ca5b7 rejected from java.util.concurrent.ThreadPoolExecutor@72b0b06b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,907 DEBUG [Listener at localhost/46875-EventThread] zookeeper.ZKWatcher(600): regionserver:45649-0x100644ea8d30001, quorum=127.0.0.1:58002, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 22:01:51,907 ERROR [Listener at localhost/46875-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@710b0996 rejected from java.util.concurrent.ThreadPoolExecutor@72b0b06b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 22:01:51,907 INFO [RS:0;jenkins-hbase9:45649] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,45649,1676671306011; zookeeper connection closed. 2023-02-17 22:01:51,907 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@271b76d7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@271b76d7 2023-02-17 22:01:51,907 INFO [Listener at localhost/46875] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 22:01:51,908 WARN [Listener at localhost/46875] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:51,917 INFO [Listener at localhost/46875] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:51,931 WARN [BP-1526140224-172.31.2.10-1676671305362 heartbeating to localhost/127.0.0.1:33265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1526140224-172.31.2.10-1676671305362 (Datanode Uuid 89ea6fc3-d6f2-4f91-82b1-7ae7b97e7df6) service to localhost/127.0.0.1:33265 2023-02-17 22:01:51,932 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/dfs/data/data3/current/BP-1526140224-172.31.2.10-1676671305362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:51,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/dfs/data/data4/current/BP-1526140224-172.31.2.10-1676671305362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:52,035 WARN [Listener at localhost/46875] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 22:01:52,105 INFO [Listener at localhost/46875] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:52,206 WARN [BP-1526140224-172.31.2.10-1676671305362 heartbeating to localhost/127.0.0.1:33265] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 22:01:52,206 WARN [BP-1526140224-172.31.2.10-1676671305362 heartbeating to localhost/127.0.0.1:33265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1526140224-172.31.2.10-1676671305362 (Datanode Uuid f466f7d3-b45f-4028-9462-4400e980a01e) service to localhost/127.0.0.1:33265 2023-02-17 22:01:52,207 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/dfs/data/data1/current/BP-1526140224-172.31.2.10-1676671305362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:52,207 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c568bc03-08fe-72be-22b3-344177486252/cluster_6778ba6b-b569-cdfe-f084-ef74b4d5941d/dfs/data/data2/current/BP-1526140224-172.31.2.10-1676671305362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 22:01:52,220 INFO [Listener at localhost/46875] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 22:01:52,332 INFO [Listener at localhost/46875] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 22:01:52,359 INFO [Listener at localhost/46875] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 22:01:52,374 INFO [Listener at localhost/46875] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 272) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:33265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46875 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33265 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:33265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase9.apache.org,36647,1676671305972)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (298043509) connection to localhost/127.0.0.1:33265 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=592 (was 575) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=348 (was 265) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=7696 (was 6592) - AvailableMemoryMB LEAK? -