2023-02-19 19:59:54,438 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-19 19:59:54,486 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=168, AvailableMemoryMB=11295 2023-02-19 19:59:54,783 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653 2023-02-19 19:59:54,790 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 19:59:54,790 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037, deleteOnExit=true 2023-02-19 19:59:54,790 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 19:59:54,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/test.cache.data in system properties and HBase conf 2023-02-19 19:59:54,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 19:59:54,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop.log.dir in system properties and HBase conf 2023-02-19 19:59:54,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 19:59:54,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 19:59:54,793 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 19:59:54,899 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-19 19:59:55,266 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 19:59:55,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 19:59:55,272 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 19:59:55,273 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 19:59:55,273 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 19:59:55,274 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 19:59:55,274 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 19:59:55,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 19:59:55,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 19:59:55,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 19:59:55,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/nfs.dump.dir in system properties and HBase conf 2023-02-19 19:59:55,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/java.io.tmpdir in system properties and HBase conf 2023-02-19 19:59:55,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 19:59:55,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 19:59:55,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 19:59:55,758 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 19:59:55,762 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 19:59:56,034 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-19 19:59:56,193 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-19 19:59:56,208 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 19:59:56,245 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 19:59:56,281 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/java.io.tmpdir/Jetty_localhost_38967_hdfs____.3jd5b5/webapp 2023-02-19 19:59:56,434 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38967 2023-02-19 19:59:56,445 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 19:59:56,446 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 19:59:56,961 WARN [Listener at localhost/39291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 19:59:57,057 WARN [Listener at localhost/39291] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 19:59:57,080 WARN [Listener at localhost/39291] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 19:59:57,086 INFO [Listener at localhost/39291] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 19:59:57,090 INFO [Listener at localhost/39291] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/java.io.tmpdir/Jetty_localhost_40219_datanode____ayzeth/webapp 2023-02-19 19:59:57,197 INFO [Listener at localhost/39291] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40219 2023-02-19 19:59:57,630 WARN [Listener at localhost/35513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 19:59:57,660 WARN [Listener at localhost/35513] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 19:59:57,664 WARN [Listener at localhost/35513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 19:59:57,666 INFO [Listener at localhost/35513] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 19:59:57,673 INFO [Listener at localhost/35513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/java.io.tmpdir/Jetty_localhost_42165_datanode____hsdk61/webapp 2023-02-19 19:59:57,786 INFO [Listener at localhost/35513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42165 2023-02-19 19:59:57,799 WARN [Listener at localhost/34167] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 19:59:58,109 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c836fe465090455: Processing first storage report for DS-71ce3db3-30cb-42db-9545-493245897c03 from datanode 62b7715f-874a-4710-b4b1-4a020b20aa35 2023-02-19 19:59:58,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c836fe465090455: from storage DS-71ce3db3-30cb-42db-9545-493245897c03 node DatanodeRegistration(127.0.0.1:35129, datanodeUuid=62b7715f-874a-4710-b4b1-4a020b20aa35, infoPort=35389, infoSecurePort=0, ipcPort=34167, storageInfo=lv=-57;cid=testClusterID;nsid=204406685;c=1676836795828), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-19 19:59:58,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1d16ea15fab54de2: Processing first storage report for DS-a4037843-93d2-4326-a6aa-2239cd49061c from datanode 88365ac8-a411-414f-8f04-d01d7f33feab 2023-02-19 19:59:58,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1d16ea15fab54de2: from storage DS-a4037843-93d2-4326-a6aa-2239cd49061c node DatanodeRegistration(127.0.0.1:38577, datanodeUuid=88365ac8-a411-414f-8f04-d01d7f33feab, infoPort=39601, infoSecurePort=0, ipcPort=35513, storageInfo=lv=-57;cid=testClusterID;nsid=204406685;c=1676836795828), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 19:59:58,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c836fe465090455: Processing first storage report for DS-4ec35847-7461-43ba-a01e-151864bc9c25 from datanode 62b7715f-874a-4710-b4b1-4a020b20aa35 2023-02-19 19:59:58,112 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c836fe465090455: from storage DS-4ec35847-7461-43ba-a01e-151864bc9c25 node DatanodeRegistration(127.0.0.1:35129, datanodeUuid=62b7715f-874a-4710-b4b1-4a020b20aa35, infoPort=35389, infoSecurePort=0, ipcPort=34167, storageInfo=lv=-57;cid=testClusterID;nsid=204406685;c=1676836795828), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-19 19:59:58,112 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1d16ea15fab54de2: Processing first storage report for DS-bf27709e-e894-4aee-b33e-10505c46d13c from datanode 88365ac8-a411-414f-8f04-d01d7f33feab 2023-02-19 19:59:58,112 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1d16ea15fab54de2: from storage DS-bf27709e-e894-4aee-b33e-10505c46d13c node DatanodeRegistration(127.0.0.1:38577, datanodeUuid=88365ac8-a411-414f-8f04-d01d7f33feab, infoPort=39601, infoSecurePort=0, ipcPort=35513, storageInfo=lv=-57;cid=testClusterID;nsid=204406685;c=1676836795828), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 19:59:58,203 DEBUG [Listener at localhost/34167] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653 2023-02-19 19:59:58,290 INFO [Listener at localhost/34167] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/zookeeper_0, clientPort=60266, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 19:59:58,313 INFO [Listener at localhost/34167] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60266 2023-02-19 19:59:58,334 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 19:59:58,337 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 19:59:59,012 INFO [Listener at localhost/34167] util.FSUtils(479): Created version file at hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508 with version=8 2023-02-19 19:59:59,013 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 19:59:59,015 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 19:59:59,017 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/hbase-staging 2023-02-19 19:59:59,339 INFO [Listener at localhost/34167] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-19 19:59:59,828 INFO [Listener at localhost/34167] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 19:59:59,861 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 19:59:59,862 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 19:59:59,862 INFO [Listener at localhost/34167] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 19:59:59,862 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 19:59:59,862 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:00,002 INFO [Listener at localhost/34167] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:00,074 DEBUG [Listener at localhost/34167] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-19 20:00:00,168 INFO [Listener at localhost/34167] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45653 2023-02-19 20:00:00,179 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,181 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,202 INFO [Listener at localhost/34167] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45653 connecting to ZooKeeper ensemble=127.0.0.1:60266 2023-02-19 20:00:00,246 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:456530x0, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:00,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45653-0x1006e2ae8fe0000 connected 2023-02-19 20:00:00,279 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:00,280 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:00,284 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:00,291 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45653 2023-02-19 20:00:00,292 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45653 2023-02-19 20:00:00,292 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45653 2023-02-19 20:00:00,293 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45653 2023-02-19 20:00:00,293 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45653 2023-02-19 20:00:00,302 INFO [Listener at localhost/34167] master.HMaster(444): hbase.rootdir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508, hbase.cluster.distributed=false 2023-02-19 20:00:00,375 INFO [Listener at localhost/34167] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:00,375 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:00,376 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:00,376 INFO [Listener at localhost/34167] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:00,376 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:00,376 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:00,381 INFO [Listener at localhost/34167] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:00,384 INFO [Listener at localhost/34167] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37601 2023-02-19 20:00:00,386 INFO [Listener at localhost/34167] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:00,393 DEBUG [Listener at localhost/34167] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:00,394 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,396 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,398 INFO [Listener at localhost/34167] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37601 connecting to ZooKeeper ensemble=127.0.0.1:60266 2023-02-19 20:00:00,402 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:376010x0, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:00,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37601-0x1006e2ae8fe0001 connected 2023-02-19 20:00:00,404 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:00,405 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:00,406 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:00,407 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37601 2023-02-19 20:00:00,407 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37601 2023-02-19 20:00:00,408 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37601 2023-02-19 20:00:00,410 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37601 2023-02-19 20:00:00,411 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37601 2023-02-19 20:00:00,424 INFO [Listener at localhost/34167] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:00,424 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:00,424 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:00,425 INFO [Listener at localhost/34167] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:00,425 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:00,425 INFO [Listener at localhost/34167] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:00,425 INFO [Listener at localhost/34167] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:00,427 INFO [Listener at localhost/34167] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46391 2023-02-19 20:00:00,427 INFO [Listener at localhost/34167] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:00,428 DEBUG [Listener at localhost/34167] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:00,429 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,432 INFO [Listener at localhost/34167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,435 INFO [Listener at localhost/34167] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46391 connecting to ZooKeeper ensemble=127.0.0.1:60266 2023-02-19 20:00:00,442 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:463910x0, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:00,443 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): regionserver:463910x0, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:00,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46391-0x1006e2ae8fe0002 connected 2023-02-19 20:00:00,444 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:00,445 DEBUG [Listener at localhost/34167] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:00,446 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46391 2023-02-19 20:00:00,446 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46391 2023-02-19 20:00:00,447 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46391 2023-02-19 20:00:00,447 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46391 2023-02-19 20:00:00,447 DEBUG [Listener at localhost/34167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46391 2023-02-19 20:00:00,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:00,462 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:00,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:00,482 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:00,482 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:00,482 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:00,483 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:00,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:00,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45653,1676836799180 from backup master directory 2023-02-19 20:00:00,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:00,488 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:00,488 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:00,489 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:00,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:00,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-19 20:00:00,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-19 20:00:00,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/hbase.id with ID: 28c7831e-9d15-4d03-95cf-9d7ba57ae438 2023-02-19 20:00:00,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:00,628 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:00,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x01dc5a09 to 127.0.0.1:60266 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:00,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4edfbec7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:00,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:00,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:00,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-19 20:00:00,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-19 20:00:00,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-19 20:00:00,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-19 20:00:00,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:00,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store-tmp 2023-02-19 20:00:00,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:00,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:00,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:00,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:00,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:00,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:00,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:00,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:00,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/WALs/jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:00,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45653%2C1676836799180, suffix=, logDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/WALs/jenkins-hbase4.apache.org,45653,1676836799180, archiveDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:00,928 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK] 2023-02-19 20:00:00,928 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK] 2023-02-19 20:00:00,936 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-19 20:00:01,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/WALs/jenkins-hbase4.apache.org,45653,1676836799180/jenkins-hbase4.apache.org%2C45653%2C1676836799180.1676836800873 2023-02-19 20:00:01,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK], DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK]] 2023-02-19 20:00:01,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:01,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:01,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:01,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:01,085 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:01,093 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:01,126 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:01,138 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:01,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:01,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:01,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:01,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:01,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70328520, jitterRate=0.04797661304473877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:01,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:01,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:01,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:01,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:01,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:01,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-19 20:00:01,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-19 20:00:01,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:01,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:01,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:01,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:01,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:01,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:01,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:01,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:01,316 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:01,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:01,335 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:01,335 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:01,335 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:01,335 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:01,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45653,1676836799180, sessionid=0x1006e2ae8fe0000, setting cluster-up flag (Was=false) 2023-02-19 20:00:01,353 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:01,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:01,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:01,367 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:01,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:01,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:01,377 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.hbase-snapshot/.tmp 2023-02-19 20:00:01,455 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(952): ClusterId : 28c7831e-9d15-4d03-95cf-9d7ba57ae438 2023-02-19 20:00:01,455 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(952): ClusterId : 28c7831e-9d15-4d03-95cf-9d7ba57ae438 2023-02-19 20:00:01,462 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:01,462 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:01,472 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:01,472 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:01,473 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:01,473 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:01,477 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:01,477 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:01,484 DEBUG [RS:1;jenkins-hbase4:46391] zookeeper.ReadOnlyZKClient(139): Connect 0x58ecfb27 to 127.0.0.1:60266 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:01,484 DEBUG [RS:0;jenkins-hbase4:37601] zookeeper.ReadOnlyZKClient(139): Connect 0x24e10509 to 127.0.0.1:60266 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:01,503 DEBUG [RS:1;jenkins-hbase4:46391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f51254, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:01,507 DEBUG [RS:1;jenkins-hbase4:46391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@333f73b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:01,511 DEBUG [RS:0;jenkins-hbase4:37601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23bf183d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:01,511 DEBUG [RS:0;jenkins-hbase4:37601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c53c9d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:01,537 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37601 2023-02-19 20:00:01,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:01,542 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46391 2023-02-19 20:00:01,545 INFO [RS:1;jenkins-hbase4:46391] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:01,545 INFO [RS:0;jenkins-hbase4:37601] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:01,545 INFO [RS:0;jenkins-hbase4:37601] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:01,545 INFO [RS:1;jenkins-hbase4:46391] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:01,545 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:01,545 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:01,549 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45653,1676836799180 with isa=jenkins-hbase4.apache.org/172.31.14.131:37601, startcode=1676836800374 2023-02-19 20:00:01,549 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45653,1676836799180 with isa=jenkins-hbase4.apache.org/172.31.14.131:46391, startcode=1676836800423 2023-02-19 20:00:01,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:01,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:01,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:01,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:01,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:01,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:01,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836831559 2023-02-19 20:00:01,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:01,565 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:01,566 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:01,568 DEBUG [RS:1;jenkins-hbase4:46391] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:01,568 DEBUG [RS:0;jenkins-hbase4:37601] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:01,572 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:01,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:01,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:01,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:01,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:01,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:01,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:01,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:01,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:01,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:01,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:01,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836801600,5,FailOnTimeoutGroup] 2023-02-19 20:00:01,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836801600,5,FailOnTimeoutGroup] 2023-02-19 20:00:01,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:01,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,634 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:01,636 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:01,637 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508 2023-02-19 20:00:01,651 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43327, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:01,651 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41657, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:01,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,676 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45653] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,677 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:01,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:01,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/info 2023-02-19 20:00:01,684 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:01,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:01,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:01,688 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:01,689 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:01,689 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:01,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:01,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/table 2023-02-19 20:00:01,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:01,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:01,696 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740 2023-02-19 20:00:01,697 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508 2023-02-19 20:00:01,697 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508 2023-02-19 20:00:01,697 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39291 2023-02-19 20:00:01,698 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39291 2023-02-19 20:00:01,698 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:01,698 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740 2023-02-19 20:00:01,698 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:01,702 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:01,704 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:01,705 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:01,709 DEBUG [RS:0;jenkins-hbase4:37601] zookeeper.ZKUtil(162): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,709 WARN [RS:0;jenkins-hbase4:37601] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:01,709 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:01,709 INFO [RS:0;jenkins-hbase4:37601] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:01,709 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46391,1676836800423] 2023-02-19 20:00:01,710 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37601,1676836800374] 2023-02-19 20:00:01,710 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,710 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70822773, jitterRate=0.055341556668281555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:01,710 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:01,710 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:01,711 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:01,711 DEBUG [RS:1;jenkins-hbase4:46391] zookeeper.ZKUtil(162): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,711 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:01,712 WARN [RS:1;jenkins-hbase4:46391] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:01,712 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:01,712 INFO [RS:1;jenkins-hbase4:46391] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:01,712 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:01,713 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,714 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:01,715 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:01,722 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:01,722 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:01,723 DEBUG [RS:0;jenkins-hbase4:37601] zookeeper.ZKUtil(162): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,723 DEBUG [RS:1;jenkins-hbase4:46391] zookeeper.ZKUtil(162): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,724 DEBUG [RS:1;jenkins-hbase4:46391] zookeeper.ZKUtil(162): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,726 DEBUG [RS:0;jenkins-hbase4:37601] zookeeper.ZKUtil(162): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:01,738 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:01,738 DEBUG [RS:1;jenkins-hbase4:46391] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:01,746 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:01,749 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:01,750 INFO [RS:1;jenkins-hbase4:46391] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:01,750 INFO [RS:0;jenkins-hbase4:37601] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:01,771 INFO [RS:1;jenkins-hbase4:46391] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:01,771 INFO [RS:0;jenkins-hbase4:37601] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:01,775 INFO [RS:0;jenkins-hbase4:37601] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:01,775 INFO [RS:1;jenkins-hbase4:46391] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:01,776 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,776 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,777 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:01,777 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:01,786 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,786 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,786 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,786 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,786 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,786 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,786 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,786 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,786 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:01,787 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:1;jenkins-hbase4:46391] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,787 DEBUG [RS:0;jenkins-hbase4:37601] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:01,789 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,789 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,789 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,789 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,789 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,789 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,807 INFO [RS:1;jenkins-hbase4:46391] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:01,807 INFO [RS:0;jenkins-hbase4:37601] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:01,810 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46391,1676836800423-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,811 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37601,1676836800374-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:01,829 INFO [RS:1;jenkins-hbase4:46391] regionserver.Replication(203): jenkins-hbase4.apache.org,46391,1676836800423 started 2023-02-19 20:00:01,829 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46391,1676836800423, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46391, sessionid=0x1006e2ae8fe0002 2023-02-19 20:00:01,830 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:01,830 DEBUG [RS:1;jenkins-hbase4:46391] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,830 DEBUG [RS:1;jenkins-hbase4:46391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46391,1676836800423' 2023-02-19 20:00:01,830 DEBUG [RS:1;jenkins-hbase4:46391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:01,830 DEBUG [RS:1;jenkins-hbase4:46391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:01,831 INFO [RS:0;jenkins-hbase4:37601] regionserver.Replication(203): jenkins-hbase4.apache.org,37601,1676836800374 started 2023-02-19 20:00:01,831 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37601,1676836800374, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37601, sessionid=0x1006e2ae8fe0001 2023-02-19 20:00:01,831 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:01,831 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:01,831 DEBUG [RS:0;jenkins-hbase4:37601] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,831 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:01,832 DEBUG [RS:0;jenkins-hbase4:37601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37601,1676836800374' 2023-02-19 20:00:01,832 DEBUG [RS:0;jenkins-hbase4:37601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:01,832 DEBUG [RS:1;jenkins-hbase4:46391] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:01,832 DEBUG [RS:1;jenkins-hbase4:46391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46391,1676836800423' 2023-02-19 20:00:01,832 DEBUG [RS:1;jenkins-hbase4:46391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:01,832 DEBUG [RS:0;jenkins-hbase4:37601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:01,833 DEBUG [RS:1;jenkins-hbase4:46391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:01,833 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:01,833 DEBUG [RS:1;jenkins-hbase4:46391] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:01,833 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:01,833 INFO [RS:1;jenkins-hbase4:46391] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:01,833 DEBUG [RS:0;jenkins-hbase4:37601] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:01,834 DEBUG [RS:0;jenkins-hbase4:37601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37601,1676836800374' 2023-02-19 20:00:01,834 DEBUG [RS:0;jenkins-hbase4:37601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:01,834 INFO [RS:1;jenkins-hbase4:46391] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:01,834 DEBUG [RS:0;jenkins-hbase4:37601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:01,835 DEBUG [RS:0;jenkins-hbase4:37601] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:01,835 INFO [RS:0;jenkins-hbase4:37601] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:01,835 INFO [RS:0;jenkins-hbase4:37601] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:01,901 DEBUG [jenkins-hbase4:45653] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:01,906 DEBUG [jenkins-hbase4:45653] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:01,913 DEBUG [jenkins-hbase4:45653] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:01,913 DEBUG [jenkins-hbase4:45653] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:01,913 DEBUG [jenkins-hbase4:45653] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:01,916 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37601,1676836800374, state=OPENING 2023-02-19 20:00:01,923 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:01,925 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:01,926 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:01,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:02,119 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:02,121 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:02,125 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43554, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:02,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:02,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:02,143 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37601%2C1676836800374.meta, suffix=.meta, logDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,37601,1676836800374, archiveDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/oldWALs, maxLogs=32 2023-02-19 20:00:02,165 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK] 2023-02-19 20:00:02,165 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK] 2023-02-19 20:00:02,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,37601,1676836800374/jenkins-hbase4.apache.org%2C37601%2C1676836800374.meta.1676836802146.meta 2023-02-19 20:00:02,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK], DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK]] 2023-02-19 20:00:02,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:02,173 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:02,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:02,206 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:02,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:02,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:02,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:02,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:02,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:02,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/info 2023-02-19 20:00:02,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/info 2023-02-19 20:00:02,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:02,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:02,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:02,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:02,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:02,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:02,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:02,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:02,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/table 2023-02-19 20:00:02,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/table 2023-02-19 20:00:02,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:02,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:02,230 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740 2023-02-19 20:00:02,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740 2023-02-19 20:00:02,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:02,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:02,244 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67231844, jitterRate=0.0018325448036193848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:02,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:02,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836802111 2023-02-19 20:00:02,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:02,277 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:02,278 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37601,1676836800374, state=OPEN 2023-02-19 20:00:02,281 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:02,281 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:02,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:02,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37601,1676836800374 in 351 msec 2023-02-19 20:00:02,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:02,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 555 msec 2023-02-19 20:00:02,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 863 msec 2023-02-19 20:00:02,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836802297, completionTime=-1 2023-02-19 20:00:02,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:02,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:02,386 DEBUG [hconnection-0x1b88fc9e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:02,391 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:02,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:02,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836862415 2023-02-19 20:00:02,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836922415 2023-02-19 20:00:02,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 117 msec 2023-02-19 20:00:02,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45653,1676836799180-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:02,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45653,1676836799180-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:02,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45653,1676836799180-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:02,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45653, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:02,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:02,457 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:02,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:02,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:02,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:02,479 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:02,483 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:02,513 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:02,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8 empty. 2023-02-19 20:00:02,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:02,517 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:02,548 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:02,551 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f4d4ce2f02c0040a4eaa238fd76b2c8, NAME => 'hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:02,568 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:02,568 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3f4d4ce2f02c0040a4eaa238fd76b2c8, disabling compactions & flushes 2023-02-19 20:00:02,568 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:02,569 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:02,569 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. after waiting 0 ms 2023-02-19 20:00:02,569 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:02,569 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:02,569 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3f4d4ce2f02c0040a4eaa238fd76b2c8: 2023-02-19 20:00:02,574 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:02,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836802577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836802577"}]},"ts":"1676836802577"} 2023-02-19 20:00:02,616 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:02,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:02,623 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836802619"}]},"ts":"1676836802619"} 2023-02-19 20:00:02,628 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:02,632 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:02,634 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:02,634 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:02,634 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:02,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3f4d4ce2f02c0040a4eaa238fd76b2c8, ASSIGN}] 2023-02-19 20:00:02,639 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3f4d4ce2f02c0040a4eaa238fd76b2c8, ASSIGN 2023-02-19 20:00:02,641 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3f4d4ce2f02c0040a4eaa238fd76b2c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37601,1676836800374; forceNewPlan=false, retain=false 2023-02-19 20:00:02,793 INFO [jenkins-hbase4:45653] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:02,794 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3f4d4ce2f02c0040a4eaa238fd76b2c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:02,794 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836802794"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836802794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836802794"}]},"ts":"1676836802794"} 2023-02-19 20:00:02,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3f4d4ce2f02c0040a4eaa238fd76b2c8, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:02,845 INFO [RS:1;jenkins-hbase4:46391] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46391%2C1676836800423, suffix=, logDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,46391,1676836800423, archiveDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/oldWALs, maxLogs=32 2023-02-19 20:00:02,845 INFO [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37601%2C1676836800374, suffix=, logDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,37601,1676836800374, archiveDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/oldWALs, maxLogs=32 2023-02-19 20:00:02,864 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK] 2023-02-19 20:00:02,867 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK] 2023-02-19 20:00:02,872 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK] 2023-02-19 20:00:02,873 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK] 2023-02-19 20:00:02,950 INFO [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,37601,1676836800374/jenkins-hbase4.apache.org%2C37601%2C1676836800374.1676836802847 2023-02-19 20:00:02,950 INFO [RS:1;jenkins-hbase4:46391] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/WALs/jenkins-hbase4.apache.org,46391,1676836800423/jenkins-hbase4.apache.org%2C46391%2C1676836800423.1676836802847 2023-02-19 20:00:02,960 DEBUG [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK], DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK]] 2023-02-19 20:00:02,995 DEBUG [RS:1;jenkins-hbase4:46391] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38577,DS-a4037843-93d2-4326-a6aa-2239cd49061c,DISK], DatanodeInfoWithStorage[127.0.0.1:35129,DS-71ce3db3-30cb-42db-9545-493245897c03,DISK]] 2023-02-19 20:00:02,999 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:03,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f4d4ce2f02c0040a4eaa238fd76b2c8, NAME => 'hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:03,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,004 INFO [StoreOpener-3f4d4ce2f02c0040a4eaa238fd76b2c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,007 DEBUG [StoreOpener-3f4d4ce2f02c0040a4eaa238fd76b2c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/info 2023-02-19 20:00:03,007 DEBUG [StoreOpener-3f4d4ce2f02c0040a4eaa238fd76b2c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/info 2023-02-19 20:00:03,008 INFO [StoreOpener-3f4d4ce2f02c0040a4eaa238fd76b2c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f4d4ce2f02c0040a4eaa238fd76b2c8 columnFamilyName info 2023-02-19 20:00:03,009 INFO [StoreOpener-3f4d4ce2f02c0040a4eaa238fd76b2c8-1] regionserver.HStore(310): Store=3f4d4ce2f02c0040a4eaa238fd76b2c8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:03,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:03,028 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:03,029 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f4d4ce2f02c0040a4eaa238fd76b2c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74711207, jitterRate=0.11328373849391937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:03,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f4d4ce2f02c0040a4eaa238fd76b2c8: 2023-02-19 20:00:03,031 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8., pid=6, masterSystemTime=1676836802971 2023-02-19 20:00:03,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:03,037 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:03,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3f4d4ce2f02c0040a4eaa238fd76b2c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:03,038 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836803038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836803038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836803038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836803038"}]},"ts":"1676836803038"} 2023-02-19 20:00:03,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:03,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3f4d4ce2f02c0040a4eaa238fd76b2c8, server=jenkins-hbase4.apache.org,37601,1676836800374 in 245 msec 2023-02-19 20:00:03,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:03,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3f4d4ce2f02c0040a4eaa238fd76b2c8, ASSIGN in 411 msec 2023-02-19 20:00:03,054 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:03,054 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836803054"}]},"ts":"1676836803054"} 2023-02-19 20:00:03,057 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:03,062 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:03,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 595 msec 2023-02-19 20:00:03,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:03,083 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:03,083 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:03,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:03,160 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:03,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 50 msec 2023-02-19 20:00:03,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:03,197 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:03,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-02-19 20:00:03,218 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:03,222 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:03,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.733sec 2023-02-19 20:00:03,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:03,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:03,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:03,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45653,1676836799180-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:03,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45653,1676836799180-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:03,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:03,262 DEBUG [Listener at localhost/34167] zookeeper.ReadOnlyZKClient(139): Connect 0x5a711c8e to 127.0.0.1:60266 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:03,266 DEBUG [Listener at localhost/34167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d37733c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:03,311 DEBUG [hconnection-0x59b26233-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:03,323 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:03,333 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:03,333 DEBUG [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:03,342 DEBUG [Listener at localhost/34167] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:03,345 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:03,350 INFO [Listener at localhost/34167] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 20:00:03,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 20:00:03,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:03,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:36672 deadline: 1676836863354, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 20:00:03,373 INFO [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 20:00:03,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:03,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 20:00:03,391 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:03,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:03,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 20:00:03,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:03,419 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de 2023-02-19 20:00:03,419 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:03,419 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:03,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:03,419 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473 2023-02-19 20:00:03,420 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:03,420 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de empty. 2023-02-19 20:00:03,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:03,420 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:03,420 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f empty. 2023-02-19 20:00:03,423 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473 empty. 2023-02-19 20:00:03,423 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c empty. 2023-02-19 20:00:03,423 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 empty. 2023-02-19 20:00:03,423 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de 2023-02-19 20:00:03,423 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:03,423 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 empty. 2023-02-19 20:00:03,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:03,424 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 empty. 2023-02-19 20:00:03,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:03,424 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 empty. 2023-02-19 20:00:03,424 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 empty. 2023-02-19 20:00:03,425 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:03,426 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:03,427 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:03,427 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:03,427 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473 2023-02-19 20:00:03,427 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:03,428 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:03,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b empty. 2023-02-19 20:00:03,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:03,429 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 20:00:03,450 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:03,453 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d168b17c98bde6385f00e772f0499f5f, NAME => 'testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,453 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d15edcbc7cb2674444030e09dd5bfe4c, NAME => 'testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,453 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ba93d94e14622472df062907637943de, NAME => 'testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,513 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,514 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ba93d94e14622472df062907637943de, disabling compactions & flushes 2023-02-19 20:00:03,514 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,514 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:03,514 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d15edcbc7cb2674444030e09dd5bfe4c, disabling compactions & flushes 2023-02-19 20:00:03,514 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:03,514 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:03,514 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. after waiting 0 ms 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d168b17c98bde6385f00e772f0499f5f, disabling compactions & flushes 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. after waiting 0 ms 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:03,515 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:03,515 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:03,515 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:03,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:03,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. after waiting 0 ms 2023-02-19 20:00:03,549 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7235463d891746a453faec138077c473, NAME => 'testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:03,549 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:03,550 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:03,550 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2db37fc62020b472c0c8c4c1bf89bdb1, NAME => 'testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,550 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 37b2ef2266aba1094eab2784dd808274, NAME => 'testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:03,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 37b2ef2266aba1094eab2784dd808274, disabling compactions & flushes 2023-02-19 20:00:03,592 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:03,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:03,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. after waiting 0 ms 2023-02-19 20:00:03,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:03,593 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:03,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:03,593 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c34bea63a85f971bab08616425dd7c3, NAME => 'testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,594 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7235463d891746a453faec138077c473, disabling compactions & flushes 2023-02-19 20:00:03,593 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,594 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:03,594 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2db37fc62020b472c0c8c4c1bf89bdb1, disabling compactions & flushes 2023-02-19 20:00:03,594 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:03,594 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:03,594 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. after waiting 0 ms 2023-02-19 20:00:03,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:03,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:03,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. after waiting 0 ms 2023-02-19 20:00:03,595 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:03,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:03,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:03,595 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:03,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:03,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 28dce26a123d894bb24f763c1dcff071, NAME => 'testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2dab961d0af4317acbd9859c0d1b5ba4, NAME => 'testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,625 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9c34bea63a85f971bab08616425dd7c3, disabling compactions & flushes 2023-02-19 20:00:03,627 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:03,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:03,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. after waiting 0 ms 2023-02-19 20:00:03,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:03,627 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:03,627 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:03,628 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 832c81e26d05e3d747deeac06a6e038b, NAME => 'testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp 2023-02-19 20:00:03,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 28dce26a123d894bb24f763c1dcff071, disabling compactions & flushes 2023-02-19 20:00:03,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:03,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:03,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. after waiting 0 ms 2023-02-19 20:00:03,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:03,635 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:03,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:03,636 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 2dab961d0af4317acbd9859c0d1b5ba4, disabling compactions & flushes 2023-02-19 20:00:03,637 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:03,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:03,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. after waiting 0 ms 2023-02-19 20:00:03,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:03,637 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:03,637 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:03,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:03,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 832c81e26d05e3d747deeac06a6e038b, disabling compactions & flushes 2023-02-19 20:00:03,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:03,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:03,650 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. after waiting 0 ms 2023-02-19 20:00:03,651 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:03,651 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:03,651 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:03,660 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:03,662 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,662 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,662 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,663 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,663 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676836803381.7235463d891746a453faec138077c473.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,663 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,663 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,664 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,664 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,664 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836803661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836803661"}]},"ts":"1676836803661"} 2023-02-19 20:00:03,716 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 20:00:03,718 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:03,719 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836803718"}]},"ts":"1676836803718"} 2023-02-19 20:00:03,721 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 20:00:03,726 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:03,739 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:03,739 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:03,739 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:03,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, ASSIGN}] 2023-02-19 20:00:03,743 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, ASSIGN 2023-02-19 20:00:03,744 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, ASSIGN 2023-02-19 20:00:03,744 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, ASSIGN 2023-02-19 20:00:03,744 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, ASSIGN 2023-02-19 20:00:03,746 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46391,1676836800423; forceNewPlan=false, retain=false 2023-02-19 20:00:03,746 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37601,1676836800374; forceNewPlan=false, retain=false 2023-02-19 20:00:03,746 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46391,1676836800423; forceNewPlan=false, retain=false 2023-02-19 20:00:03,747 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37601,1676836800374; forceNewPlan=false, retain=false 2023-02-19 20:00:03,747 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, ASSIGN 2023-02-19 20:00:03,748 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, ASSIGN 2023-02-19 20:00:03,749 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, ASSIGN 2023-02-19 20:00:03,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, ASSIGN 2023-02-19 20:00:03,749 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, ASSIGN 2023-02-19 20:00:03,749 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46391,1676836800423; forceNewPlan=false, retain=false 2023-02-19 20:00:03,750 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46391,1676836800423; forceNewPlan=false, retain=false 2023-02-19 20:00:03,750 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37601,1676836800374; forceNewPlan=false, retain=false 2023-02-19 20:00:03,750 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37601,1676836800374; forceNewPlan=false, retain=false 2023-02-19 20:00:03,751 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46391,1676836800423; forceNewPlan=false, retain=false 2023-02-19 20:00:03,752 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, ASSIGN 2023-02-19 20:00:03,753 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37601,1676836800374; forceNewPlan=false, retain=false 2023-02-19 20:00:03,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:03,896 INFO [jenkins-hbase4:45653] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 20:00:03,901 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=28dce26a123d894bb24f763c1dcff071, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:03,901 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2db37fc62020b472c0c8c4c1bf89bdb1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:03,901 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=832c81e26d05e3d747deeac06a6e038b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:03,901 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=37b2ef2266aba1094eab2784dd808274, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:03,901 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d15edcbc7cb2674444030e09dd5bfe4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:03,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803901"}]},"ts":"1676836803901"} 2023-02-19 20:00:03,901 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803901"}]},"ts":"1676836803901"} 2023-02-19 20:00:03,901 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803901"}]},"ts":"1676836803901"} 2023-02-19 20:00:03,901 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803900"}]},"ts":"1676836803900"} 2023-02-19 20:00:03,901 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836803901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803901"}]},"ts":"1676836803901"} 2023-02-19 20:00:03,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 37b2ef2266aba1094eab2784dd808274, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:03,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 2db37fc62020b472c0c8c4c1bf89bdb1, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:03,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure d15edcbc7cb2674444030e09dd5bfe4c, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:03,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 28dce26a123d894bb24f763c1dcff071, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:03,912 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=2dab961d0af4317acbd9859c0d1b5ba4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:03,912 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803911"}]},"ts":"1676836803911"} 2023-02-19 20:00:03,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 832c81e26d05e3d747deeac06a6e038b, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:03,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 2dab961d0af4317acbd9859c0d1b5ba4, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:03,917 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d168b17c98bde6385f00e772f0499f5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:03,917 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803917"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803917"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803917"}]},"ts":"1676836803917"} 2023-02-19 20:00:03,919 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9c34bea63a85f971bab08616425dd7c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:03,920 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803919"}]},"ts":"1676836803919"} 2023-02-19 20:00:03,920 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ba93d94e14622472df062907637943de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:03,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836803920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803920"}]},"ts":"1676836803920"} 2023-02-19 20:00:03,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure d168b17c98bde6385f00e772f0499f5f, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:03,923 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7235463d891746a453faec138077c473, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:03,924 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676836803381.7235463d891746a453faec138077c473.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836803923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836803923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836803923"}]},"ts":"1676836803923"} 2023-02-19 20:00:03,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 9c34bea63a85f971bab08616425dd7c3, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:03,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure ba93d94e14622472df062907637943de, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:03,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 7235463d891746a453faec138077c473, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:04,057 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:04,058 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:04,061 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46036, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:04,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:04,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:04,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 832c81e26d05e3d747deeac06a6e038b, NAME => 'testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 20:00:04,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,069 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,072 DEBUG [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f1 2023-02-19 20:00:04,072 DEBUG [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f1 2023-02-19 20:00:04,072 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 832c81e26d05e3d747deeac06a6e038b columnFamilyName f1 2023-02-19 20:00:04,073 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(310): Store=832c81e26d05e3d747deeac06a6e038b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,074 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:04,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d168b17c98bde6385f00e772f0499f5f, NAME => 'testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 20:00:04,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,082 DEBUG [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f2 2023-02-19 20:00:04,082 DEBUG [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f2 2023-02-19 20:00:04,083 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 832c81e26d05e3d747deeac06a6e038b columnFamilyName f2 2023-02-19 20:00:04,083 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(310): Store=832c81e26d05e3d747deeac06a6e038b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,086 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,088 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1 2023-02-19 20:00:04,088 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1 2023-02-19 20:00:04,089 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d168b17c98bde6385f00e772f0499f5f columnFamilyName f1 2023-02-19 20:00:04,089 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(310): Store=d168b17c98bde6385f00e772f0499f5f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,090 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,092 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2 2023-02-19 20:00:04,092 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2 2023-02-19 20:00:04,092 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d168b17c98bde6385f00e772f0499f5f columnFamilyName f2 2023-02-19 20:00:04,093 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(310): Store=d168b17c98bde6385f00e772f0499f5f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 832c81e26d05e3d747deeac06a6e038b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67867091, jitterRate=0.011298462748527527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:04,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b., pid=25, masterSystemTime=1676836804057 2023-02-19 20:00:04,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:04,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:04,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:04,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:04,105 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=832c81e26d05e3d747deeac06a6e038b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:04,105 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836804105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804105"}]},"ts":"1676836804105"} 2023-02-19 20:00:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 37b2ef2266aba1094eab2784dd808274, NAME => 'testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 20:00:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d168b17c98bde6385f00e772f0499f5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71434364, jitterRate=0.06445497274398804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:04,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f., pid=27, masterSystemTime=1676836804070 2023-02-19 20:00:04,110 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:04,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:04,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:04,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7235463d891746a453faec138077c473, NAME => 'testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 20:00:04,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7235463d891746a453faec138077c473 2023-02-19 20:00:04,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-19 20:00:04,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7235463d891746a453faec138077c473 2023-02-19 20:00:04,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 832c81e26d05e3d747deeac06a6e038b, server=jenkins-hbase4.apache.org,46391,1676836800423 in 197 msec 2023-02-19 20:00:04,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7235463d891746a453faec138077c473 2023-02-19 20:00:04,114 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1 2023-02-19 20:00:04,114 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1 2023-02-19 20:00:04,114 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d168b17c98bde6385f00e772f0499f5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:04,114 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804114"}]},"ts":"1676836804114"} 2023-02-19 20:00:04,114 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37b2ef2266aba1094eab2784dd808274 columnFamilyName f1 2023-02-19 20:00:04,115 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7235463d891746a453faec138077c473 2023-02-19 20:00:04,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, ASSIGN in 373 msec 2023-02-19 20:00:04,117 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(310): Store=37b2ef2266aba1094eab2784dd808274/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,117 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,119 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1 2023-02-19 20:00:04,119 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1 2023-02-19 20:00:04,119 INFO [StoreOpener-7235463d891746a453faec138077c473-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7235463d891746a453faec138077c473 columnFamilyName f1 2023-02-19 20:00:04,120 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(310): Store=7235463d891746a453faec138077c473/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,120 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7235463d891746a453faec138077c473 2023-02-19 20:00:04,120 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2 2023-02-19 20:00:04,124 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2 2023-02-19 20:00:04,125 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37b2ef2266aba1094eab2784dd808274 columnFamilyName f2 2023-02-19 20:00:04,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-19 20:00:04,126 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2 2023-02-19 20:00:04,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure d168b17c98bde6385f00e772f0499f5f, server=jenkins-hbase4.apache.org,37601,1676836800374 in 198 msec 2023-02-19 20:00:04,127 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(310): Store=37b2ef2266aba1094eab2784dd808274/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,127 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2 2023-02-19 20:00:04,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, ASSIGN in 386 msec 2023-02-19 20:00:04,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,129 INFO [StoreOpener-7235463d891746a453faec138077c473-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7235463d891746a453faec138077c473 columnFamilyName f2 2023-02-19 20:00:04,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,130 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(310): Store=7235463d891746a453faec138077c473/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473 2023-02-19 20:00:04,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473 2023-02-19 20:00:04,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:04,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7235463d891746a453faec138077c473 2023-02-19 20:00:04,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 37b2ef2266aba1094eab2784dd808274; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73113974, jitterRate=0.0894831120967865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7235463d891746a453faec138077c473; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72236340, jitterRate=0.0764053463935852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:04,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:04,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274., pid=21, masterSystemTime=1676836804057 2023-02-19 20:00:04,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473., pid=30, masterSystemTime=1676836804070 2023-02-19 20:00:04,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:04,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:04,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:04,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d15edcbc7cb2674444030e09dd5bfe4c, NAME => 'testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 20:00:04,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=37b2ef2266aba1094eab2784dd808274, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:04,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804150"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804150"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804150"}]},"ts":"1676836804150"} 2023-02-19 20:00:04,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:04,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:04,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:04,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2dab961d0af4317acbd9859c0d1b5ba4, NAME => 'testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 20:00:04,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,151 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7235463d891746a453faec138077c473, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:04,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676836803381.7235463d891746a453faec138077c473.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804151"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804151"}]},"ts":"1676836804151"} 2023-02-19 20:00:04,153 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,154 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,158 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1 2023-02-19 20:00:04,158 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1 2023-02-19 20:00:04,158 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1 2023-02-19 20:00:04,158 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1 2023-02-19 20:00:04,159 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dab961d0af4317acbd9859c0d1b5ba4 columnFamilyName f1 2023-02-19 20:00:04,159 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15edcbc7cb2674444030e09dd5bfe4c columnFamilyName f1 2023-02-19 20:00:04,161 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(310): Store=2dab961d0af4317acbd9859c0d1b5ba4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,161 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(310): Store=d15edcbc7cb2674444030e09dd5bfe4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-19 20:00:04,162 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 37b2ef2266aba1094eab2784dd808274, server=jenkins-hbase4.apache.org,46391,1676836800423 in 252 msec 2023-02-19 20:00:04,162 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,164 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2 2023-02-19 20:00:04,164 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2 2023-02-19 20:00:04,164 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2 2023-02-19 20:00:04,165 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2 2023-02-19 20:00:04,165 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15edcbc7cb2674444030e09dd5bfe4c columnFamilyName f2 2023-02-19 20:00:04,165 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dab961d0af4317acbd9859c0d1b5ba4 columnFamilyName f2 2023-02-19 20:00:04,166 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(310): Store=2dab961d0af4317acbd9859c0d1b5ba4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,166 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(310): Store=d15edcbc7cb2674444030e09dd5bfe4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-19 20:00:04,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 7235463d891746a453faec138077c473, server=jenkins-hbase4.apache.org,37601,1676836800374 in 223 msec 2023-02-19 20:00:04,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, ASSIGN in 422 msec 2023-02-19 20:00:04,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, ASSIGN in 428 msec 2023-02-19 20:00:04,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:04,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:04,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d15edcbc7cb2674444030e09dd5bfe4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67550543, jitterRate=0.006581529974937439}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2dab961d0af4317acbd9859c0d1b5ba4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61635991, jitterRate=-0.0815521627664566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:04,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:04,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4., pid=26, masterSystemTime=1676836804070 2023-02-19 20:00:04,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c., pid=23, masterSystemTime=1676836804057 2023-02-19 20:00:04,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:04,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:04,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:04,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ba93d94e14622472df062907637943de, NAME => 'testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 20:00:04,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ba93d94e14622472df062907637943de 2023-02-19 20:00:04,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ba93d94e14622472df062907637943de 2023-02-19 20:00:04,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ba93d94e14622472df062907637943de 2023-02-19 20:00:04,186 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=2dab961d0af4317acbd9859c0d1b5ba4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:04,186 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804186"}]},"ts":"1676836804186"} 2023-02-19 20:00:04,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:04,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:04,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:04,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2db37fc62020b472c0c8c4c1bf89bdb1, NAME => 'testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 20:00:04,187 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba93d94e14622472df062907637943de 2023-02-19 20:00:04,188 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d15edcbc7cb2674444030e09dd5bfe4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:04,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,189 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804188"}]},"ts":"1676836804188"} 2023-02-19 20:00:04,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,192 DEBUG [StoreOpener-ba93d94e14622472df062907637943de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f1 2023-02-19 20:00:04,193 DEBUG [StoreOpener-ba93d94e14622472df062907637943de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f1 2023-02-19 20:00:04,193 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba93d94e14622472df062907637943de columnFamilyName f1 2023-02-19 20:00:04,194 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,194 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(310): Store=ba93d94e14622472df062907637943de/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,196 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba93d94e14622472df062907637943de 2023-02-19 20:00:04,198 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1 2023-02-19 20:00:04,198 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1 2023-02-19 20:00:04,199 DEBUG [StoreOpener-ba93d94e14622472df062907637943de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f2 2023-02-19 20:00:04,199 DEBUG [StoreOpener-ba93d94e14622472df062907637943de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f2 2023-02-19 20:00:04,199 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db37fc62020b472c0c8c4c1bf89bdb1 columnFamilyName f1 2023-02-19 20:00:04,199 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba93d94e14622472df062907637943de columnFamilyName f2 2023-02-19 20:00:04,201 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(310): Store=ba93d94e14622472df062907637943de/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,202 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(310): Store=2db37fc62020b472c0c8c4c1bf89bdb1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de 2023-02-19 20:00:04,202 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de 2023-02-19 20:00:04,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-19 20:00:04,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 2dab961d0af4317acbd9859c0d1b5ba4, server=jenkins-hbase4.apache.org,37601,1676836800374 in 276 msec 2023-02-19 20:00:04,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-19 20:00:04,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure d15edcbc7cb2674444030e09dd5bfe4c, server=jenkins-hbase4.apache.org,46391,1676836800423 in 288 msec 2023-02-19 20:00:04,206 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2 2023-02-19 20:00:04,207 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2 2023-02-19 20:00:04,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, ASSIGN in 464 msec 2023-02-19 20:00:04,207 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, ASSIGN in 464 msec 2023-02-19 20:00:04,207 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db37fc62020b472c0c8c4c1bf89bdb1 columnFamilyName f2 2023-02-19 20:00:04,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,209 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(310): Store=2db37fc62020b472c0c8c4c1bf89bdb1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ba93d94e14622472df062907637943de 2023-02-19 20:00:04,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:04,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ba93d94e14622472df062907637943de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64838888, jitterRate=-0.03382527828216553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:04,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de., pid=29, masterSystemTime=1676836804070 2023-02-19 20:00:04,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2db37fc62020b472c0c8c4c1bf89bdb1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66440532, jitterRate=-0.009958922863006592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:04,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:04,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:04,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:04,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c34bea63a85f971bab08616425dd7c3, NAME => 'testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 20:00:04,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1., pid=22, masterSystemTime=1676836804057 2023-02-19 20:00:04,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,223 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ba93d94e14622472df062907637943de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:04,223 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836804223"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804223"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804223"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804223"}]},"ts":"1676836804223"} 2023-02-19 20:00:04,226 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:04,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:04,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:04,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 28dce26a123d894bb24f763c1dcff071, NAME => 'testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 20:00:04,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:04,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2db37fc62020b472c0c8c4c1bf89bdb1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:04,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804227"}]},"ts":"1676836804227"} 2023-02-19 20:00:04,228 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1 2023-02-19 20:00:04,228 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1 2023-02-19 20:00:04,229 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c34bea63a85f971bab08616425dd7c3 columnFamilyName f1 2023-02-19 20:00:04,230 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(310): Store=9c34bea63a85f971bab08616425dd7c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,230 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,230 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,232 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2 2023-02-19 20:00:04,233 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2 2023-02-19 20:00:04,233 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c34bea63a85f971bab08616425dd7c3 columnFamilyName f2 2023-02-19 20:00:04,234 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(310): Store=9c34bea63a85f971bab08616425dd7c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-19 20:00:04,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure ba93d94e14622472df062907637943de, server=jenkins-hbase4.apache.org,37601,1676836800374 in 294 msec 2023-02-19 20:00:04,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,235 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1 2023-02-19 20:00:04,236 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1 2023-02-19 20:00:04,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-19 20:00:04,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 2db37fc62020b472c0c8c4c1bf89bdb1, server=jenkins-hbase4.apache.org,46391,1676836800423 in 324 msec 2023-02-19 20:00:04,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, ASSIGN in 495 msec 2023-02-19 20:00:04,239 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28dce26a123d894bb24f763c1dcff071 columnFamilyName f1 2023-02-19 20:00:04,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, ASSIGN in 497 msec 2023-02-19 20:00:04,239 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(310): Store=28dce26a123d894bb24f763c1dcff071/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,240 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,243 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2 2023-02-19 20:00:04,243 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2 2023-02-19 20:00:04,244 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28dce26a123d894bb24f763c1dcff071 columnFamilyName f2 2023-02-19 20:00:04,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:04,245 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(310): Store=28dce26a123d894bb24f763c1dcff071/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:04,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c34bea63a85f971bab08616425dd7c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61193002, jitterRate=-0.08815321326255798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:04,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3., pid=28, masterSystemTime=1676836804070 2023-02-19 20:00:04,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:04,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:04,264 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9c34bea63a85f971bab08616425dd7c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:04,264 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804263"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804263"}]},"ts":"1676836804263"} 2023-02-19 20:00:04,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:04,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 28dce26a123d894bb24f763c1dcff071; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70646439, jitterRate=0.05271397531032562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:04,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:04,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071., pid=24, masterSystemTime=1676836804057 2023-02-19 20:00:04,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:04,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:04,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-19 20:00:04,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 9c34bea63a85f971bab08616425dd7c3, server=jenkins-hbase4.apache.org,37601,1676836800374 in 336 msec 2023-02-19 20:00:04,271 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=28dce26a123d894bb24f763c1dcff071, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:04,271 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836804271"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836804271"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836804271"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836804271"}]},"ts":"1676836804271"} 2023-02-19 20:00:04,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, ASSIGN in 531 msec 2023-02-19 20:00:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-19 20:00:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 28dce26a123d894bb24f763c1dcff071, server=jenkins-hbase4.apache.org,46391,1676836800423 in 364 msec 2023-02-19 20:00:04,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-19 20:00:04,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, ASSIGN in 550 msec 2023-02-19 20:00:04,296 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:04,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836804296"}]},"ts":"1676836804296"} 2023-02-19 20:00:04,299 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 20:00:04,302 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:04,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 917 msec 2023-02-19 20:00:04,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:04,566 INFO [Listener at localhost/34167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 20:00:04,566 DEBUG [Listener at localhost/34167] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 20:00:04,568 INFO [Listener at localhost/34167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:04,576 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 20:00:04,576 INFO [Listener at localhost/34167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:04,576 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 20:00:04,577 INFO [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:04,693 DEBUG [hconnection-0x59b26233-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:04,736 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:04,755 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37601] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:04,757 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46391] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:05,093 INFO [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:05,097 INFO [Listener at localhost/34167] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:05,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836805112 (current time:1676836805112). 2023-02-19 20:00:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:05,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] zookeeper.ReadOnlyZKClient(139): Connect 0x6400ef9f to 127.0.0.1:60266 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:05,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@db9f266, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:05,141 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:05,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6400ef9f to 127.0.0.1:60266 2023-02-19 20:00:05,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:05,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:05,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:05,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:05,173 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:05,175 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676837405174 2023-02-19 20:00:05,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:05,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 20:00:05,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:05,181 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:05,182 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:05,182 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:05,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 18 msec 2023-02-19 20:00:05,185 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:05,186 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676837405186 2023-02-19 20:00:05,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-19 20:00:05,256 INFO [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-19 20:00:05,256 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:05,256 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-19 20:00:05,256 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 20:00:05,257 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:05,257 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:05,260 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:05,260 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,260 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:05,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:05,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:05,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:05,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:05,262 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,262 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-19 20:00:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-19 20:00:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:05,263 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 20:00:05,263 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 20:00:05,263 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,263 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:05,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-19 20:00:05,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-19 20:00:05,266 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-19 20:00:05,266 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:00:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-19 20:00:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:05,269 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-19 20:00:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:00:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-19 20:00:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37601,1676836800374' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-19 20:00:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46391,1676836800423' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-19 20:00:05,272 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,272 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:05,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37601,1676836800374' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-19 20:00:05,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d2c58ec[Count = 1] remaining members to acquire global barrier 2023-02-19 20:00:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:05,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:05,276 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,277 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:05,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:05,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46391,1676836800423' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-19 20:00:05,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d2c58ec[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:05,279 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 20:00:05,279 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:05,281 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:05,282 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:05,282 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:05,282 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:05,282 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:05,282 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:05,283 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. started... 2023-02-19 20:00:05,283 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. started... 2023-02-19 20:00:05,289 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:05,289 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. started... 2023-02-19 20:00:05,295 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2dab961d0af4317acbd9859c0d1b5ba4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:05,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:05,295 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:00:05,295 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:05,296 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. started... 2023-02-19 20:00:05,295 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d168b17c98bde6385f00e772f0499f5f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:05,296 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:05,296 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. started... 2023-02-19 20:00:05,295 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:00:05,298 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:05,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:05,299 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:05,299 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2db37fc62020b472c0c8c4c1bf89bdb1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:05,299 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9c34bea63a85f971bab08616425dd7c3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:05,296 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:05,296 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 28dce26a123d894bb24f763c1dcff071 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:00:05,296 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:05,304 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. started... 2023-02-19 20:00:05,306 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:05,307 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,313 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,318 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:05,318 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:05,499 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:05,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:05,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:05,501 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 20:00:05,561 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f1/8a10e347d51442238229e492f95eda3b 2023-02-19 20:00:05,567 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f1/0f36151543644b158dd29a5d5e8ec282 2023-02-19 20:00:05,568 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f1/3fdcac3666b840889a1a7216480f375e 2023-02-19 20:00:05,571 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f1/be10315d79cf43a99fcec403aea51636 2023-02-19 20:00:05,576 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f1/af06af41b027458d8257793fbed19846 2023-02-19 20:00:05,728 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f2/0895f6defcd04d05bc43956dceb6a425 2023-02-19 20:00:05,738 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f2/c497e8a2d2f24aa4a605f9efeddb297a 2023-02-19 20:00:05,746 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f1/0f36151543644b158dd29a5d5e8ec282 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/0f36151543644b158dd29a5d5e8ec282 2023-02-19 20:00:05,749 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f1/3fdcac3666b840889a1a7216480f375e as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/3fdcac3666b840889a1a7216480f375e 2023-02-19 20:00:05,751 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f2/410df5722a9e4276a9aa2ada077060f7 2023-02-19 20:00:05,753 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f2/59e59494d491446eb7cd0d8e2ac5b2b6 2023-02-19 20:00:05,766 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f1/af06af41b027458d8257793fbed19846 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/af06af41b027458d8257793fbed19846 2023-02-19 20:00:05,767 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f1/be10315d79cf43a99fcec403aea51636 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/be10315d79cf43a99fcec403aea51636 2023-02-19 20:00:05,769 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/0f36151543644b158dd29a5d5e8ec282, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:05,774 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/3fdcac3666b840889a1a7216480f375e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,782 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/af06af41b027458d8257793fbed19846, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,784 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f2/c497e8a2d2f24aa4a605f9efeddb297a as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/c497e8a2d2f24aa4a605f9efeddb297a 2023-02-19 20:00:05,785 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f2/0895f6defcd04d05bc43956dceb6a425 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0895f6defcd04d05bc43956dceb6a425 2023-02-19 20:00:05,785 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f2/410df5722a9e4276a9aa2ada077060f7 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/410df5722a9e4276a9aa2ada077060f7 2023-02-19 20:00:05,787 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/be10315d79cf43a99fcec403aea51636, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,789 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f2/59e59494d491446eb7cd0d8e2ac5b2b6 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/59e59494d491446eb7cd0d8e2ac5b2b6 2023-02-19 20:00:05,795 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/410df5722a9e4276a9aa2ada077060f7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,797 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2db37fc62020b472c0c8c4c1bf89bdb1 in 498ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:05,799 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 20:00:05,801 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:05,801 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,802 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,802 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:05,802 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/af06af41b027458d8257793fbed19846] hfiles 2023-02-19 20:00:05,802 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0895f6defcd04d05bc43956dceb6a425, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:05,802 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/af06af41b027458d8257793fbed19846 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:05,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:05,804 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 20:00:05,804 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 28dce26a123d894bb24f763c1dcff071 in 515ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:05,808 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/410df5722a9e4276a9aa2ada077060f7] hfiles 2023-02-19 20:00:05,808 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/410df5722a9e4276a9aa2ada077060f7 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,817 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/0f36151543644b158dd29a5d5e8ec282] hfiles 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/0f36151543644b158dd29a5d5e8ec282 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0895f6defcd04d05bc43956dceb6a425] hfiles 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0895f6defcd04d05bc43956dceb6a425 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. completed. 2023-02-19 20:00:05,818 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:05,820 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:05,820 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:00:05,820 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. started... 2023-02-19 20:00:05,821 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 37b2ef2266aba1094eab2784dd808274 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:05,825 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/59e59494d491446eb7cd0d8e2ac5b2b6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,826 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/c497e8a2d2f24aa4a605f9efeddb297a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,826 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9c34bea63a85f971bab08616425dd7c3 in 527ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/be10315d79cf43a99fcec403aea51636] hfiles 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/be10315d79cf43a99fcec403aea51636 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,827 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2dab961d0af4317acbd9859c0d1b5ba4 in 532ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/59e59494d491446eb7cd0d8e2ac5b2b6] hfiles 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:05,827 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/59e59494d491446eb7cd0d8e2ac5b2b6 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,828 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,828 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,828 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/3fdcac3666b840889a1a7216480f375e] hfiles 2023-02-19 20:00:05,828 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/3fdcac3666b840889a1a7216480f375e for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,828 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/c497e8a2d2f24aa4a605f9efeddb297a] hfiles 2023-02-19 20:00:05,828 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/c497e8a2d2f24aa4a605f9efeddb297a for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,878 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. completed. 2023-02-19 20:00:05,878 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:05,878 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:05,878 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:00:05,878 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. started... 2023-02-19 20:00:05,881 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7235463d891746a453faec138077c473 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:05,890 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. completed. 2023-02-19 20:00:05,890 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:05,890 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:05,890 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. started... 2023-02-19 20:00:05,890 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:00:05,891 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d15edcbc7cb2674444030e09dd5bfe4c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:00:05,891 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. completed. 2023-02-19 20:00:05,891 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:05,892 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:05,892 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. started... 2023-02-19 20:00:05,892 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:00:05,892 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:05,893 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,893 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,893 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:05,893 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:05,895 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f1/e65fdfb2c3f64ea89825291cdccceb58 2023-02-19 20:00:05,922 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. completed. 2023-02-19 20:00:05,922 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:05,922 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:00:05,925 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f1/8d947894b0f64cefa07bb0ef4b9a4b56 2023-02-19 20:00:05,940 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f1/f697c86cf0f84e2492703fb9f224f32a 2023-02-19 20:00:05,943 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f2/ea63a0be33c24b5893eecb0185bb316a 2023-02-19 20:00:05,953 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f1/e65fdfb2c3f64ea89825291cdccceb58 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/e65fdfb2c3f64ea89825291cdccceb58 2023-02-19 20:00:05,964 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/e65fdfb2c3f64ea89825291cdccceb58, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,965 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f2/ea63a0be33c24b5893eecb0185bb316a as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/ea63a0be33c24b5893eecb0185bb316a 2023-02-19 20:00:05,978 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/ea63a0be33c24b5893eecb0185bb316a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:05,979 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 37b2ef2266aba1094eab2784dd808274 in 159ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:05,979 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:05,980 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,980 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:05,980 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/e65fdfb2c3f64ea89825291cdccceb58] hfiles 2023-02-19 20:00:05,980 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/e65fdfb2c3f64ea89825291cdccceb58 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,980 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/ea63a0be33c24b5893eecb0185bb316a] hfiles 2023-02-19 20:00:05,980 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/ea63a0be33c24b5893eecb0185bb316a for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:05,983 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f2/9aa20e4b31b4427ab9fa6d9ab7e02460 2023-02-19 20:00:06,003 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f1/8d947894b0f64cefa07bb0ef4b9a4b56 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/8d947894b0f64cefa07bb0ef4b9a4b56 2023-02-19 20:00:06,012 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/8d947894b0f64cefa07bb0ef4b9a4b56, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:06,013 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f2/d95309bbbbaf4d299f8a9366a0be529c 2023-02-19 20:00:06,014 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f2/9aa20e4b31b4427ab9fa6d9ab7e02460 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/9aa20e4b31b4427ab9fa6d9ab7e02460 2023-02-19 20:00:06,036 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. completed. 2023-02-19 20:00:06,036 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:00:06,036 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/9aa20e4b31b4427ab9fa6d9ab7e02460, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:06,038 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f1/f697c86cf0f84e2492703fb9f224f32a as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/f697c86cf0f84e2492703fb9f224f32a 2023-02-19 20:00:06,038 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7235463d891746a453faec138077c473 in 157ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/8d947894b0f64cefa07bb0ef4b9a4b56] hfiles 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/8d947894b0f64cefa07bb0ef4b9a4b56 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/9aa20e4b31b4427ab9fa6d9ab7e02460] hfiles 2023-02-19 20:00:06,039 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/9aa20e4b31b4427ab9fa6d9ab7e02460 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,047 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/f697c86cf0f84e2492703fb9f224f32a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:06,049 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f2/d95309bbbbaf4d299f8a9366a0be529c as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/d95309bbbbaf4d299f8a9366a0be529c 2023-02-19 20:00:06,068 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/d95309bbbbaf4d299f8a9366a0be529c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:06,069 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d15edcbc7cb2674444030e09dd5bfe4c in 178ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/f697c86cf0f84e2492703fb9f224f32a] hfiles 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/f697c86cf0f84e2492703fb9f224f32a for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/d95309bbbbaf4d299f8a9366a0be529c] hfiles 2023-02-19 20:00:06,070 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/d95309bbbbaf4d299f8a9366a0be529c for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,108 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f2/2f231bd596f340d9abddcaf646f95710 2023-02-19 20:00:06,112 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. completed. 2023-02-19 20:00:06,112 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:06,113 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:00:06,121 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f1/8a10e347d51442238229e492f95eda3b as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/8a10e347d51442238229e492f95eda3b 2023-02-19 20:00:06,130 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/8a10e347d51442238229e492f95eda3b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:06,131 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f2/2f231bd596f340d9abddcaf646f95710 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/2f231bd596f340d9abddcaf646f95710 2023-02-19 20:00:06,138 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/2f231bd596f340d9abddcaf646f95710, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:06,139 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d168b17c98bde6385f00e772f0499f5f in 850ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/8a10e347d51442238229e492f95eda3b] hfiles 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/8a10e347d51442238229e492f95eda3b for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/2f231bd596f340d9abddcaf646f95710] hfiles 2023-02-19 20:00:06,140 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/2f231bd596f340d9abddcaf646f95710 for snapshot=testWithMapReduceMultiRegion 2023-02-19 20:00:06,150 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. completed. 2023-02-19 20:00:06,151 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:06,151 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:00:06,287 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. completed. 2023-02-19 20:00:06,287 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:00:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:00:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-19 20:00:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46391,1676836800423' in zk 2023-02-19 20:00:06,291 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,291 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:00:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:06,291 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:06,291 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-19 20:00:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46391,1676836800423': 2023-02-19 20:00:06,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46391,1676836800423' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 20:00:06,304 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:06,307 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-19 20:00:06,499 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. completed. 2023-02-19 20:00:06,499 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:00:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:00:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-19 20:00:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37601,1676836800374' in zk 2023-02-19 20:00:06,505 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:00:06,505 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:06,505 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-19 20:00:06,506 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37601,1676836800374': 2023-02-19 20:00:06,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37601,1676836800374' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:06,514 INFO [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-19 20:00:06,514 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:06,514 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:06,514 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-19 20:00:06,514 INFO [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:06,517 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:06,517 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:06,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,518 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:06,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,525 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:06,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,533 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,533 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 20:00:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:06,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:06,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:06,553 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:06,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-19 20:00:06,553 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:06,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:06,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:06,554 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 20:00:06,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:06,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-19 20:00:06,555 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:06,555 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:06,555 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:06,555 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 20:00:06,555 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 20:00:06,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 20:00:06,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-19 20:00:06,755 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-19 20:00:06,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 20:00:06,756 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 20:00:06,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676836805178Consolidate snapshot: testWithMapReduceMultiRegion at 1676836806555 (+1377 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676836806555Writing data manifest for testWithMapReduceMultiRegion at 1676836806594 (+39 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676836806641 (+47 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676836806755 (+114 ms) 2023-02-19 20:00:06,757 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:06,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5770 sec 2023-02-19 20:00:07,307 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:07,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:07,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:07,309 INFO [Listener at localhost/34167] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:07,326 INFO [Listener at localhost/34167] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:07,341 INFO [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:07,421 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37601] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:07,442 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46391] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:07,603 INFO [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:07,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:07,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 20:00:07,627 INFO [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 20:00:07,627 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:07,627 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 20:00:07,627 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 20:00:07,628 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:07,628 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:07,631 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:07,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:07,631 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:07,631 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:07,631 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:07,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:07,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 20:00:07,632 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:07,633 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:07,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 20:00:07,636 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:07,636 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 20:00:07,636 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:07,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:07,637 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 20:00:07,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:07,640 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:07,640 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. started... 2023-02-19 20:00:07,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:07,640 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:07,640 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. started... 2023-02-19 20:00:07,640 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d168b17c98bde6385f00e772f0499f5f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:07,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:07,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:07,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:07,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 20:00:07,642 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2dab961d0af4317acbd9859c0d1b5ba4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:07,642 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 20:00:07,642 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:07,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 20:00:07,642 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:07,642 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. started... 2023-02-19 20:00:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 20:00:07,644 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:07,645 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c34bea63a85f971bab08616425dd7c3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:07,645 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 20:00:07,648 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:07,648 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. started... 2023-02-19 20:00:07,649 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 28dce26a123d894bb24f763c1dcff071 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 20:00:07,652 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:07,652 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. started... 2023-02-19 20:00:07,652 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:07,652 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:07,661 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 20:00:07,661 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:07,661 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:07,663 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. started... 2023-02-19 20:00:07,663 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2db37fc62020b472c0c8c4c1bf89bdb1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:07,663 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 20:00:07,661 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:07,668 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. started... 2023-02-19 20:00:07,668 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 37b2ef2266aba1094eab2784dd808274 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:07,744 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-19 20:00:07,850 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f1/3d626cf539f04d9593ae648bacd745cf 2023-02-19 20:00:07,857 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f1/b7d098e70cb646f9943f647e097e99b7 2023-02-19 20:00:07,900 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f1/9e8c8d0ebf694c90abf9d2c812f3125a 2023-02-19 20:00:07,919 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f1/7b5736c062154645b07ba6a3a1650303 2023-02-19 20:00:07,944 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f1/e00f95984c2c49f3a7ce21c9508f19ad 2023-02-19 20:00:07,945 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f2/c8097613a9474d63bce7c660ac4b65c5 2023-02-19 20:00:07,957 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f1/b7d098e70cb646f9943f647e097e99b7 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/b7d098e70cb646f9943f647e097e99b7 2023-02-19 20:00:07,965 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f1/d7d6329f648e4ff99346a3e914208451 2023-02-19 20:00:07,966 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/b7d098e70cb646f9943f647e097e99b7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:07,968 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/.tmp/f2/c8097613a9474d63bce7c660ac4b65c5 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/c8097613a9474d63bce7c660ac4b65c5 2023-02-19 20:00:07,969 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 20:00:07,970 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 20:00:07,978 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/c8097613a9474d63bce7c660ac4b65c5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:07,980 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f2/0c8a7262cd4d4d43a6df59a989fc91ba 2023-02-19 20:00:07,981 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d168b17c98bde6385f00e772f0499f5f in 340ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:07,981 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:07,981 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:07,981 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:07,981 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 20:00:07,981 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. started... 2023-02-19 20:00:07,982 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7235463d891746a453faec138077c473 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:07,988 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f1/3d626cf539f04d9593ae648bacd745cf as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/3d626cf539f04d9593ae648bacd745cf 2023-02-19 20:00:07,994 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/3d626cf539f04d9593ae648bacd745cf, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:07,995 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/.tmp/f2/0c8a7262cd4d4d43a6df59a989fc91ba as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0c8a7262cd4d4d43a6df59a989fc91ba 2023-02-19 20:00:08,012 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f2/db0ead62b3494fc4a1d4f5aaf8069665 2023-02-19 20:00:08,015 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0c8a7262cd4d4d43a6df59a989fc91ba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:08,018 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 28dce26a123d894bb24f763c1dcff071 in 369ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,018 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:08,019 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:08,020 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f1/7b5736c062154645b07ba6a3a1650303 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/7b5736c062154645b07ba6a3a1650303 2023-02-19 20:00:08,025 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/7b5736c062154645b07ba6a3a1650303, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,026 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/.tmp/f2/db0ead62b3494fc4a1d4f5aaf8069665 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/db0ead62b3494fc4a1d4f5aaf8069665 2023-02-19 20:00:08,037 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f2/d661e3eda3ab4a7fa32d1a18acb3bcdb 2023-02-19 20:00:08,044 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:08,044 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 20:00:08,044 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. started... 2023-02-19 20:00:08,044 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d15edcbc7cb2674444030e09dd5bfe4c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 20:00:08,045 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/db0ead62b3494fc4a1d4f5aaf8069665, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,047 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2dab961d0af4317acbd9859c0d1b5ba4 in 407ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,047 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:08,047 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:08,047 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:08,047 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 20:00:08,047 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. started... 2023-02-19 20:00:08,048 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:08,048 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 20:00:08,056 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f2/d4ada6ea9e5d4329adbdd3af945a139e 2023-02-19 20:00:08,062 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f1/9e8c8d0ebf694c90abf9d2c812f3125a as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/9e8c8d0ebf694c90abf9d2c812f3125a 2023-02-19 20:00:08,064 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f1/e00f95984c2c49f3a7ce21c9508f19ad as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/e00f95984c2c49f3a7ce21c9508f19ad 2023-02-19 20:00:08,071 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/9e8c8d0ebf694c90abf9d2c812f3125a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,072 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f2/ff87b8db8d0c49ba927e8dd538c5b824 2023-02-19 20:00:08,077 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/.tmp/f2/d661e3eda3ab4a7fa32d1a18acb3bcdb as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/d661e3eda3ab4a7fa32d1a18acb3bcdb 2023-02-19 20:00:08,079 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/e00f95984c2c49f3a7ce21c9508f19ad, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,081 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/.tmp/f2/d4ada6ea9e5d4329adbdd3af945a139e as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/d4ada6ea9e5d4329adbdd3af945a139e 2023-02-19 20:00:08,088 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/d661e3eda3ab4a7fa32d1a18acb3bcdb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,090 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 37b2ef2266aba1094eab2784dd808274 in 422ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,090 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:08,090 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 20:00:08,090 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f1/d7d6329f648e4ff99346a3e914208451 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/d7d6329f648e4ff99346a3e914208451 2023-02-19 20:00:08,097 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/d7d6329f648e4ff99346a3e914208451, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,098 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/.tmp/f2/ff87b8db8d0c49ba927e8dd538c5b824 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/ff87b8db8d0c49ba927e8dd538c5b824 2023-02-19 20:00:08,105 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f1/ac015076e64a4b5994974320522d456e 2023-02-19 20:00:08,127 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f1/483a4aa17a794250bd0ef8dd9022b07c 2023-02-19 20:00:08,131 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/ff87b8db8d0c49ba927e8dd538c5b824, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,136 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9c34bea63a85f971bab08616425dd7c3 in 493ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,136 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:08,136 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:08,137 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 20:00:08,149 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/d4ada6ea9e5d4329adbdd3af945a139e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,150 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2db37fc62020b472c0c8c4c1bf89bdb1 in 487ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,151 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:08,151 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:08,151 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 20:00:08,227 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f2/b81e3836d487492f87202041fc897d9f 2023-02-19 20:00:08,235 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f1/483a4aa17a794250bd0ef8dd9022b07c as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/483a4aa17a794250bd0ef8dd9022b07c 2023-02-19 20:00:08,241 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/483a4aa17a794250bd0ef8dd9022b07c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,242 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/.tmp/f2/b81e3836d487492f87202041fc897d9f as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/b81e3836d487492f87202041fc897d9f 2023-02-19 20:00:08,247 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/b81e3836d487492f87202041fc897d9f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:08,248 INFO [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7235463d891746a453faec138077c473 in 267ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,249 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:08,249 DEBUG [rs(jenkins-hbase4.apache.org,37601,1676836800374)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:08,249 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 20:00:08,249 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 20:00:08,249 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,249 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 20:00:08,249 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37601,1676836800374' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 20:00:08,252 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,252 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:08,252 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,252 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:08,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37601,1676836800374' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 20:00:08,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c479d59[Count = 1] remaining members to acquire global barrier 2023-02-19 20:00:08,631 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f2/e705b0ca56d84ebb8fbce0caf2cd1fe1 2023-02-19 20:00:08,639 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f1/ac015076e64a4b5994974320522d456e as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/ac015076e64a4b5994974320522d456e 2023-02-19 20:00:08,645 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/ac015076e64a4b5994974320522d456e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:08,647 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/.tmp/f2/e705b0ca56d84ebb8fbce0caf2cd1fe1 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/e705b0ca56d84ebb8fbce0caf2cd1fe1 2023-02-19 20:00:08,654 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/e705b0ca56d84ebb8fbce0caf2cd1fe1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:08,655 INFO [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d15edcbc7cb2674444030e09dd5bfe4c in 611ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:08,655 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:08,655 DEBUG [rs(jenkins-hbase4.apache.org,46391,1676836800423)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:08,655 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 20:00:08,655 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 20:00:08,655 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,655 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 20:00:08,655 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46391,1676836800423' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 20:00:08,657 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,657 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:08,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:08,658 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:08,658 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:08,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:08,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:08,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46391,1676836800423' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 20:00:08,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c479d59[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:08,660 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 20:00:08,660 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,662 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,662 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 20:00:08,662 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 20:00:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 20:00:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 20:00:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46391,1676836800423' in zk 2023-02-19 20:00:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37601,1676836800374' in zk 2023-02-19 20:00:08,663 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,663 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:08,666 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 20:00:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:08,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:08,666 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,46391,1676836800423' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 20:00:08,666 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 20:00:08,667 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:08,667 DEBUG [member: 'jenkins-hbase4.apache.org,37601,1676836800374' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 20:00:08,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46391,1676836800423': 2023-02-19 20:00:08,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46391,1676836800423' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-19 20:00:08,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37601,1676836800374': 2023-02-19 20:00:08,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37601,1676836800374' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 20:00:08,676 INFO [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 20:00:08,676 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:08,676 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:08,677 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 20:00:08,677 INFO [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:08,679 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:08,679 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:08,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:08,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:08,680 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,681 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:08,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:08,684 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:08,684 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,691 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,691 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:08,692 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:08,691 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:08,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:08,692 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:08,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:08,692 DEBUG [(jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:08,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 20:00:08,692 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,696 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:08,696 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:08,696 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,697 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:08,697 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:08,697 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:08,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:08,692 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:08,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:08,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:08,699 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:08,699 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:08,800 DEBUG [Listener at localhost/34167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:08,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:08,921 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop-3919383056279304331.jar 2023-02-19 20:00:08,939 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676836805112 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:08,940 DEBUG [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce 2023-02-19 20:00:08,940 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 7235463d891746a453faec138077c473 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: ba93d94e14622472df062907637943de 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(239): region to add: d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=d168b17c98bde6385f00e772f0499f5f as d168b17c98bde6385f00e772f0499f5f in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,941 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=28dce26a123d894bb24f763c1dcff071 as 28dce26a123d894bb24f763c1dcff071 in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=2dab961d0af4317acbd9859c0d1b5ba4 as 2dab961d0af4317acbd9859c0d1b5ba4 in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=9c34bea63a85f971bab08616425dd7c3 as 9c34bea63a85f971bab08616425dd7c3 in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=832c81e26d05e3d747deeac06a6e038b as 832c81e26d05e3d747deeac06a6e038b in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=7235463d891746a453faec138077c473 as 7235463d891746a453faec138077c473 in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=2db37fc62020b472c0c8c4c1bf89bdb1 as 2db37fc62020b472c0c8c4c1bf89bdb1 in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=ba93d94e14622472df062907637943de as ba93d94e14622472df062907637943de in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=37b2ef2266aba1094eab2784dd808274 as 37b2ef2266aba1094eab2784dd808274 in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,942 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(585): clone region=d15edcbc7cb2674444030e09dd5bfe4c as d15edcbc7cb2674444030e09dd5bfe4c in snapshot testWithMapReduceMultiRegion 2023-02-19 20:00:08,947 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 2db37fc62020b472c0c8c4c1bf89bdb1, NAME => 'testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,948 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 7235463d891746a453faec138077c473, NAME => 'testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,948 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9c34bea63a85f971bab08616425dd7c3, NAME => 'testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,949 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 28dce26a123d894bb24f763c1dcff071, NAME => 'testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,949 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2dab961d0af4317acbd9859c0d1b5ba4, NAME => 'testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,949 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 832c81e26d05e3d747deeac06a6e038b, NAME => 'testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,950 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d168b17c98bde6385f00e772f0499f5f, NAME => 'testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,951 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ba93d94e14622472df062907637943de, NAME => 'testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:08,984 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:08,984 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a10e347d51442238229e492f95eda3b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:08,997 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:08,997 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 832c81e26d05e3d747deeac06a6e038b, disabling compactions & flushes 2023-02-19 20:00:08,997 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:08,997 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:08,997 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. after waiting 0 ms 2023-02-19 20:00:08,997 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:08,997 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:08,997 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:08,998 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 37b2ef2266aba1094eab2784dd808274, NAME => 'testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:09,000 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,000 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3fdcac3666b840889a1a7216480f375e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,005 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f231bd596f340d9abddcaf646f95710 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,006 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,007 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ba93d94e14622472df062907637943de, disabling compactions & flushes 2023-02-19 20:00:09,007 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:09,007 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:09,007 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. after waiting 0 ms 2023-02-19 20:00:09,007 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:09,007 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:09,007 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:09,008 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => d15edcbc7cb2674444030e09dd5bfe4c, NAME => 'testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:09,008 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d168b17c98bde6385f00e772f0499f5f, disabling compactions & flushes 2023-02-19 20:00:09,008 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:09,008 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:09,009 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. after waiting 0 ms 2023-02-19 20:00:09,009 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:09,009 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:09,009 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:09,012 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c497e8a2d2f24aa4a605f9efeddb297a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,025 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,026 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink be10315d79cf43a99fcec403aea51636 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,026 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,026 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f36151543644b158dd29a5d5e8ec282 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,029 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,029 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e65fdfb2c3f64ea89825291cdccceb58 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,029 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,029 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8d947894b0f64cefa07bb0ef4b9a4b56 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 2dab961d0af4317acbd9859c0d1b5ba4, disabling compactions & flushes 2023-02-19 20:00:09,030 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:09,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:09,030 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. after waiting 0 ms 2023-02-19 20:00:09,031 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:09,031 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:09,031 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:09,032 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0895f6defcd04d05bc43956dceb6a425 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,032 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,032 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af06af41b027458d8257793fbed19846 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,036 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9aa20e4b31b4427ab9fa6d9ab7e02460 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 7235463d891746a453faec138077c473, disabling compactions & flushes 2023-02-19 20:00:09,046 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 410df5722a9e4276a9aa2ada077060f7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,046 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 28dce26a123d894bb24f763c1dcff071, disabling compactions & flushes 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. after waiting 0 ms 2023-02-19 20:00:09,046 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:09,046 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. after waiting 0 ms 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:09,046 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:09,047 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:09,047 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:09,053 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 2db37fc62020b472c0c8c4c1bf89bdb1, disabling compactions & flushes 2023-02-19 20:00:09,053 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59e59494d491446eb7cd0d8e2ac5b2b6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,054 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:09,054 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:09,054 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. after waiting 0 ms 2023-02-19 20:00:09,054 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,054 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:09,054 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f697c86cf0f84e2492703fb9f224f32a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,054 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:09,054 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ea63a0be33c24b5893eecb0185bb316a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,054 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:09,057 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9c34bea63a85f971bab08616425dd7c3, disabling compactions & flushes 2023-02-19 20:00:09,057 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d95309bbbbaf4d299f8a9366a0be529c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 20:00:09,057 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:09,057 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:09,057 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. after waiting 0 ms 2023-02-19 20:00:09,057 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:09,057 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:09,057 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:09,057 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 37b2ef2266aba1094eab2784dd808274, disabling compactions & flushes 2023-02-19 20:00:09,058 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:09,058 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:09,058 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. after waiting 0 ms 2023-02-19 20:00:09,058 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:09,058 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:09,058 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:09,059 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing d15edcbc7cb2674444030e09dd5bfe4c, disabling compactions & flushes 2023-02-19 20:00:09,059 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:09,059 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:09,059 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. after waiting 0 ms 2023-02-19 20:00:09,059 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:09,059 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:09,059 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:09,060 INFO [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676836805112 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:09,060 DEBUG [Listener at localhost/34167] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:09,060 DEBUG [Listener at localhost/34167] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77 2023-02-19 20:00:09,061 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:09,062 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:09,062 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 20:00:09,063 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------28dce26a123d894bb24f763c1dcff071/ 2023-02-19 20:00:09,063 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,063 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,064 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=28dce26a123d894bb24f763c1dcff071-0f36151543644b158dd29a5d5e8ec282 2023-02-19 20:00:09,064 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,065 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=28dce26a123d894bb24f763c1dcff071-0895f6defcd04d05bc43956dceb6a425 2023-02-19 20:00:09,065 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------2dab961d0af4317acbd9859c0d1b5ba4/ 2023-02-19 20:00:09,065 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,065 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,066 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=2dab961d0af4317acbd9859c0d1b5ba4-3fdcac3666b840889a1a7216480f375e 2023-02-19 20:00:09,066 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,066 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=2dab961d0af4317acbd9859c0d1b5ba4-c497e8a2d2f24aa4a605f9efeddb297a 2023-02-19 20:00:09,066 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------2db37fc62020b472c0c8c4c1bf89bdb1/ 2023-02-19 20:00:09,067 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,067 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,067 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=2db37fc62020b472c0c8c4c1bf89bdb1-af06af41b027458d8257793fbed19846 2023-02-19 20:00:09,067 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,068 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=2db37fc62020b472c0c8c4c1bf89bdb1-410df5722a9e4276a9aa2ada077060f7 2023-02-19 20:00:09,068 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------37b2ef2266aba1094eab2784dd808274/ 2023-02-19 20:00:09,068 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,069 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,069 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=37b2ef2266aba1094eab2784dd808274-e65fdfb2c3f64ea89825291cdccceb58 2023-02-19 20:00:09,069 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,070 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=37b2ef2266aba1094eab2784dd808274-ea63a0be33c24b5893eecb0185bb316a 2023-02-19 20:00:09,070 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------7235463d891746a453faec138077c473/ 2023-02-19 20:00:09,070 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,070 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,071 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=7235463d891746a453faec138077c473-8d947894b0f64cefa07bb0ef4b9a4b56 2023-02-19 20:00:09,071 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,072 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=7235463d891746a453faec138077c473-9aa20e4b31b4427ab9fa6d9ab7e02460 2023-02-19 20:00:09,072 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------832c81e26d05e3d747deeac06a6e038b/ 2023-02-19 20:00:09,072 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,072 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------9c34bea63a85f971bab08616425dd7c3/ 2023-02-19 20:00:09,073 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,073 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,074 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=9c34bea63a85f971bab08616425dd7c3-be10315d79cf43a99fcec403aea51636 2023-02-19 20:00:09,074 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,074 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=9c34bea63a85f971bab08616425dd7c3-59e59494d491446eb7cd0d8e2ac5b2b6 2023-02-19 20:00:09,075 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------ba93d94e14622472df062907637943de/ 2023-02-19 20:00:09,075 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,075 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------d15edcbc7cb2674444030e09dd5bfe4c/ 2023-02-19 20:00:09,076 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,076 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,077 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=d15edcbc7cb2674444030e09dd5bfe4c-f697c86cf0f84e2492703fb9f224f32a 2023-02-19 20:00:09,077 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,077 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=d15edcbc7cb2674444030e09dd5bfe4c-d95309bbbbaf4d299f8a9366a0be529c 2023-02-19 20:00:09,077 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |----------d168b17c98bde6385f00e772f0499f5f/ 2023-02-19 20:00:09,078 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:09,078 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:09,079 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=d168b17c98bde6385f00e772f0499f5f-8a10e347d51442238229e492f95eda3b 2023-02-19 20:00:09,079 DEBUG [Listener at localhost/34167] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:09,079 DEBUG [Listener at localhost/34167] util.CommonFSUtils(702): |----------------testWithMapReduce=d168b17c98bde6385f00e772f0499f5f-2f231bd596f340d9abddcaf646f95710 2023-02-19 20:00:09,089 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,090 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,091 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,091 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,092 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,093 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,093 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,176 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop-1864415458956789481.jar 2023-02-19 20:00:09,177 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,178 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,178 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,178 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,179 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,179 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,180 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 20:00:09,180 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 20:00:09,181 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 20:00:09,181 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 20:00:09,182 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 20:00:09,182 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 20:00:09,183 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 20:00:09,183 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 20:00:09,184 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 20:00:09,184 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 20:00:09,189 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:09,190 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:09,190 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:09,191 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:09,191 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 20:00:09,261 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop-5493870061762487900.jar 2023-02-19 20:00:09,262 DEBUG [Listener at localhost/34167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 20:00:09,321 WARN [Listener at localhost/34167] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 20:00:09,335 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:09,335 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-19 20:00:09,376 INFO [Listener at localhost/34167] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 20:00:09,752 WARN [Listener at localhost/34167] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/mapreduce.cluster.local.dir/1676836809666/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 20:00:09,752 WARN [Listener at localhost/34167] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/mapreduce.cluster.local.dir/1676836809666/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 20:00:09,885 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:09,885 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:09,887 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:09,890 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:09,891 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1 2023-02-19 20:00:09,892 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28dce26a123d894bb24f763c1dcff071 columnFamilyName f1 2023-02-19 20:00:09,899 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/testWithMapReduce=28dce26a123d894bb24f763c1dcff071-0f36151543644b158dd29a5d5e8ec282 2023-02-19 20:00:09,900 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(310): Store=28dce26a123d894bb24f763c1dcff071/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:09,900 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:09,901 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2 2023-02-19 20:00:09,901 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28dce26a123d894bb24f763c1dcff071 columnFamilyName f2 2023-02-19 20:00:09,906 DEBUG [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/testWithMapReduce=28dce26a123d894bb24f763c1dcff071-0895f6defcd04d05bc43956dceb6a425 2023-02-19 20:00:09,907 INFO [StoreOpener-28dce26a123d894bb24f763c1dcff071-1] regionserver.HStore(310): Store=28dce26a123d894bb24f763c1dcff071/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:09,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:09,907 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 28dce26a123d894bb24f763c1dcff071; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63768650, jitterRate=-0.049773067235946655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:09,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:10,028 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 28dce26a123d894bb24f763c1dcff071, disabling compactions & flushes 2023-02-19 20:00:10,029 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:10,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:10,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. after waiting 0 ms 2023-02-19 20:00:10,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:10,032 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:10,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:10,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,045 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,046 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,048 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:10,049 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1 2023-02-19 20:00:10,050 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dab961d0af4317acbd9859c0d1b5ba4 columnFamilyName f1 2023-02-19 20:00:10,056 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/testWithMapReduce=2dab961d0af4317acbd9859c0d1b5ba4-3fdcac3666b840889a1a7216480f375e 2023-02-19 20:00:10,056 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(310): Store=2dab961d0af4317acbd9859c0d1b5ba4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,057 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:10,058 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2 2023-02-19 20:00:10,058 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2dab961d0af4317acbd9859c0d1b5ba4 columnFamilyName f2 2023-02-19 20:00:10,064 DEBUG [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/testWithMapReduce=2dab961d0af4317acbd9859c0d1b5ba4-c497e8a2d2f24aa4a605f9efeddb297a 2023-02-19 20:00:10,064 INFO [StoreOpener-2dab961d0af4317acbd9859c0d1b5ba4-1] regionserver.HStore(310): Store=2dab961d0af4317acbd9859c0d1b5ba4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,065 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,065 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2dab961d0af4317acbd9859c0d1b5ba4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63350695, jitterRate=-0.05600108206272125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,065 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:10,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2dab961d0af4317acbd9859c0d1b5ba4, disabling compactions & flushes 2023-02-19 20:00:10,110 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:10,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:10,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. after waiting 0 ms 2023-02-19 20:00:10,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:10,115 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:10,115 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:10,121 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,121 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,125 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,127 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:10,128 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1 2023-02-19 20:00:10,129 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37b2ef2266aba1094eab2784dd808274 columnFamilyName f1 2023-02-19 20:00:10,136 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/testWithMapReduce=37b2ef2266aba1094eab2784dd808274-e65fdfb2c3f64ea89825291cdccceb58 2023-02-19 20:00:10,136 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(310): Store=37b2ef2266aba1094eab2784dd808274/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,136 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:10,137 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2 2023-02-19 20:00:10,138 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37b2ef2266aba1094eab2784dd808274 columnFamilyName f2 2023-02-19 20:00:10,145 DEBUG [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/testWithMapReduce=37b2ef2266aba1094eab2784dd808274-ea63a0be33c24b5893eecb0185bb316a 2023-02-19 20:00:10,145 INFO [StoreOpener-37b2ef2266aba1094eab2784dd808274-1] regionserver.HStore(310): Store=37b2ef2266aba1094eab2784dd808274/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,145 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,146 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 37b2ef2266aba1094eab2784dd808274; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66747532, jitterRate=-0.005384266376495361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:10,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 37b2ef2266aba1094eab2784dd808274, disabling compactions & flushes 2023-02-19 20:00:10,193 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:10,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:10,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. after waiting 0 ms 2023-02-19 20:00:10,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:10,197 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:10,197 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:10,202 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,202 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,203 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,206 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:10,207 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1 2023-02-19 20:00:10,208 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d168b17c98bde6385f00e772f0499f5f columnFamilyName f1 2023-02-19 20:00:10,215 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/testWithMapReduce=d168b17c98bde6385f00e772f0499f5f-8a10e347d51442238229e492f95eda3b 2023-02-19 20:00:10,216 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(310): Store=d168b17c98bde6385f00e772f0499f5f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,216 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:10,217 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2 2023-02-19 20:00:10,218 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d168b17c98bde6385f00e772f0499f5f columnFamilyName f2 2023-02-19 20:00:10,225 DEBUG [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/testWithMapReduce=d168b17c98bde6385f00e772f0499f5f-2f231bd596f340d9abddcaf646f95710 2023-02-19 20:00:10,225 INFO [StoreOpener-d168b17c98bde6385f00e772f0499f5f-1] regionserver.HStore(310): Store=d168b17c98bde6385f00e772f0499f5f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,225 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d168b17c98bde6385f00e772f0499f5f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61205491, jitterRate=-0.08796711266040802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:10,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d168b17c98bde6385f00e772f0499f5f, disabling compactions & flushes 2023-02-19 20:00:10,277 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:10,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:10,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. after waiting 0 ms 2023-02-19 20:00:10,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:10,280 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:10,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:10,286 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,286 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,287 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,290 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:10,291 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1 2023-02-19 20:00:10,292 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db37fc62020b472c0c8c4c1bf89bdb1 columnFamilyName f1 2023-02-19 20:00:10,299 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/testWithMapReduce=2db37fc62020b472c0c8c4c1bf89bdb1-af06af41b027458d8257793fbed19846 2023-02-19 20:00:10,300 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(310): Store=2db37fc62020b472c0c8c4c1bf89bdb1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,300 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:10,301 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2 2023-02-19 20:00:10,302 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2db37fc62020b472c0c8c4c1bf89bdb1 columnFamilyName f2 2023-02-19 20:00:10,308 DEBUG [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/testWithMapReduce=2db37fc62020b472c0c8c4c1bf89bdb1-410df5722a9e4276a9aa2ada077060f7 2023-02-19 20:00:10,309 INFO [StoreOpener-2db37fc62020b472c0c8c4c1bf89bdb1-1] regionserver.HStore(310): Store=2db37fc62020b472c0c8c4c1bf89bdb1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,309 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,309 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2db37fc62020b472c0c8c4c1bf89bdb1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70122496, jitterRate=0.0449066162109375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,309 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:10,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2db37fc62020b472c0c8c4c1bf89bdb1, disabling compactions & flushes 2023-02-19 20:00:10,379 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:10,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:10,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. after waiting 0 ms 2023-02-19 20:00:10,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:10,383 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:10,383 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:10,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,391 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,393 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,395 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:10,396 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1 2023-02-19 20:00:10,397 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15edcbc7cb2674444030e09dd5bfe4c columnFamilyName f1 2023-02-19 20:00:10,404 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/testWithMapReduce=d15edcbc7cb2674444030e09dd5bfe4c-f697c86cf0f84e2492703fb9f224f32a 2023-02-19 20:00:10,404 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(310): Store=d15edcbc7cb2674444030e09dd5bfe4c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,404 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:10,406 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2 2023-02-19 20:00:10,406 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15edcbc7cb2674444030e09dd5bfe4c columnFamilyName f2 2023-02-19 20:00:10,418 DEBUG [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/testWithMapReduce=d15edcbc7cb2674444030e09dd5bfe4c-d95309bbbbaf4d299f8a9366a0be529c 2023-02-19 20:00:10,419 INFO [StoreOpener-d15edcbc7cb2674444030e09dd5bfe4c-1] regionserver.HStore(310): Store=d15edcbc7cb2674444030e09dd5bfe4c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,419 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d15edcbc7cb2674444030e09dd5bfe4c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59777914, jitterRate=-0.10923966765403748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:10,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d15edcbc7cb2674444030e09dd5bfe4c, disabling compactions & flushes 2023-02-19 20:00:10,469 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:10,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:10,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. after waiting 0 ms 2023-02-19 20:00:10,469 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:10,473 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:10,473 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:10,477 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,478 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,480 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,484 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7235463d891746a453faec138077c473 2023-02-19 20:00:10,485 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1 2023-02-19 20:00:10,486 INFO [StoreOpener-7235463d891746a453faec138077c473-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7235463d891746a453faec138077c473 columnFamilyName f1 2023-02-19 20:00:10,500 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/testWithMapReduce=7235463d891746a453faec138077c473-8d947894b0f64cefa07bb0ef4b9a4b56 2023-02-19 20:00:10,500 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(310): Store=7235463d891746a453faec138077c473/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,500 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7235463d891746a453faec138077c473 2023-02-19 20:00:10,510 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2 2023-02-19 20:00:10,511 INFO [StoreOpener-7235463d891746a453faec138077c473-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7235463d891746a453faec138077c473 columnFamilyName f2 2023-02-19 20:00:10,518 DEBUG [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/testWithMapReduce=7235463d891746a453faec138077c473-9aa20e4b31b4427ab9fa6d9ab7e02460 2023-02-19 20:00:10,518 INFO [StoreOpener-7235463d891746a453faec138077c473-1] regionserver.HStore(310): Store=7235463d891746a453faec138077c473/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,518 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,519 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7235463d891746a453faec138077c473; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70985369, jitterRate=0.05776442587375641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,519 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:10,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7235463d891746a453faec138077c473, disabling compactions & flushes 2023-02-19 20:00:10,558 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:10,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:10,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. after waiting 0 ms 2023-02-19 20:00:10,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:10,565 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:10,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:10,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,569 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,573 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,575 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:10,576 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1 2023-02-19 20:00:10,577 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c34bea63a85f971bab08616425dd7c3 columnFamilyName f1 2023-02-19 20:00:10,583 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/testWithMapReduce=9c34bea63a85f971bab08616425dd7c3-be10315d79cf43a99fcec403aea51636 2023-02-19 20:00:10,583 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(310): Store=9c34bea63a85f971bab08616425dd7c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,584 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:10,585 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2 2023-02-19 20:00:10,585 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c34bea63a85f971bab08616425dd7c3 columnFamilyName f2 2023-02-19 20:00:10,591 DEBUG [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(539): loaded hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/testWithMapReduce=9c34bea63a85f971bab08616425dd7c3-59e59494d491446eb7cd0d8e2ac5b2b6 2023-02-19 20:00:10,591 INFO [StoreOpener-9c34bea63a85f971bab08616425dd7c3-1] regionserver.HStore(310): Store=9c34bea63a85f971bab08616425dd7c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,591 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9c34bea63a85f971bab08616425dd7c3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60204516, jitterRate=-0.10288280248641968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:10,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9c34bea63a85f971bab08616425dd7c3, disabling compactions & flushes 2023-02-19 20:00:10,624 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:10,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:10,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. after waiting 0 ms 2023-02-19 20:00:10,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:10,627 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:10,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:10,630 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,630 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,631 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,633 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba93d94e14622472df062907637943de 2023-02-19 20:00:10,634 DEBUG [StoreOpener-ba93d94e14622472df062907637943de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f1 2023-02-19 20:00:10,635 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba93d94e14622472df062907637943de columnFamilyName f1 2023-02-19 20:00:10,635 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(310): Store=ba93d94e14622472df062907637943de/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,635 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba93d94e14622472df062907637943de 2023-02-19 20:00:10,636 DEBUG [StoreOpener-ba93d94e14622472df062907637943de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f2 2023-02-19 20:00:10,637 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba93d94e14622472df062907637943de columnFamilyName f2 2023-02-19 20:00:10,637 INFO [StoreOpener-ba93d94e14622472df062907637943de-1] regionserver.HStore(310): Store=ba93d94e14622472df062907637943de/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,637 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,638 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ba93d94e14622472df062907637943de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65755880, jitterRate=-0.020161032676696777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,638 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:10,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ba93d94e14622472df062907637943de, disabling compactions & flushes 2023-02-19 20:00:10,661 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:10,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:10,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. after waiting 0 ms 2023-02-19 20:00:10,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:10,662 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:10,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:10,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:10,665 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:10,668 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:10,670 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:10,671 DEBUG [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f1 2023-02-19 20:00:10,671 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 832c81e26d05e3d747deeac06a6e038b columnFamilyName f1 2023-02-19 20:00:10,672 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(310): Store=832c81e26d05e3d747deeac06a6e038b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,672 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:10,673 DEBUG [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39291/user/jenkins/test-data/206bb9cc-48c1-a111-6b24-2a6771e48335/testWithMapReduceMultiRegion/53311360-fd5c-4c63-80b0-f6c2b3920c77/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f2 2023-02-19 20:00:10,673 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 832c81e26d05e3d747deeac06a6e038b columnFamilyName f2 2023-02-19 20:00:10,674 INFO [StoreOpener-832c81e26d05e3d747deeac06a6e038b-1] regionserver.HStore(310): Store=832c81e26d05e3d747deeac06a6e038b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:10,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:10,674 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 832c81e26d05e3d747deeac06a6e038b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67239484, jitterRate=0.0019463896751403809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:10,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:10,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 832c81e26d05e3d747deeac06a6e038b, disabling compactions & flushes 2023-02-19 20:00:10,706 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:10,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:10,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. after waiting 0 ms 2023-02-19 20:00:10,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:10,707 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:10,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:11,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-19 20:00:11,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-19 20:00:11,841 INFO [Listener at localhost/34167] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 20:00:11,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 20:00:11,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-19 20:00:11,852 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836811852"}]},"ts":"1676836811852"} 2023-02-19 20:00:11,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:11,854 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-19 20:00:11,856 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-19 20:00:11,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, UNASSIGN}] 2023-02-19 20:00:11,862 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, UNASSIGN 2023-02-19 20:00:11,862 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, UNASSIGN 2023-02-19 20:00:11,862 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, UNASSIGN 2023-02-19 20:00:11,862 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, UNASSIGN 2023-02-19 20:00:11,863 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, UNASSIGN 2023-02-19 20:00:11,864 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=2dab961d0af4317acbd9859c0d1b5ba4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:11,864 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811863"}]},"ts":"1676836811863"} 2023-02-19 20:00:11,864 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2db37fc62020b472c0c8c4c1bf89bdb1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:11,864 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9c34bea63a85f971bab08616425dd7c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:11,864 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811864"}]},"ts":"1676836811864"} 2023-02-19 20:00:11,864 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=832c81e26d05e3d747deeac06a6e038b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:11,864 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7235463d891746a453faec138077c473, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:11,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836811864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811864"}]},"ts":"1676836811864"} 2023-02-19 20:00:11,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811864"}]},"ts":"1676836811864"} 2023-02-19 20:00:11,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676836803381.7235463d891746a453faec138077c473.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811864"}]},"ts":"1676836811864"} 2023-02-19 20:00:11,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=41, state=RUNNABLE; CloseRegionProcedure 2dab961d0af4317acbd9859c0d1b5ba4, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:11,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure 2db37fc62020b472c0c8c4c1bf89bdb1, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:11,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure 9c34bea63a85f971bab08616425dd7c3, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:11,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 832c81e26d05e3d747deeac06a6e038b, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:11,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=38, state=RUNNABLE; CloseRegionProcedure 7235463d891746a453faec138077c473, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:11,879 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, UNASSIGN 2023-02-19 20:00:11,879 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, UNASSIGN 2023-02-19 20:00:11,879 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, UNASSIGN 2023-02-19 20:00:11,880 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, UNASSIGN 2023-02-19 20:00:11,880 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, UNASSIGN 2023-02-19 20:00:11,880 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d168b17c98bde6385f00e772f0499f5f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:11,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d15edcbc7cb2674444030e09dd5bfe4c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:11,881 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811880"}]},"ts":"1676836811880"} 2023-02-19 20:00:11,881 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811880"}]},"ts":"1676836811880"} 2023-02-19 20:00:11,881 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=28dce26a123d894bb24f763c1dcff071, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:11,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811881"}]},"ts":"1676836811881"} 2023-02-19 20:00:11,881 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=37b2ef2266aba1094eab2784dd808274, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:11,882 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836811881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811881"}]},"ts":"1676836811881"} 2023-02-19 20:00:11,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=ba93d94e14622472df062907637943de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:11,882 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836811882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836811882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836811882"}]},"ts":"1676836811882"} 2023-02-19 20:00:11,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=36, state=RUNNABLE; CloseRegionProcedure d168b17c98bde6385f00e772f0499f5f, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:11,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=35, state=RUNNABLE; CloseRegionProcedure d15edcbc7cb2674444030e09dd5bfe4c, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:11,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=42, state=RUNNABLE; CloseRegionProcedure 28dce26a123d894bb24f763c1dcff071, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:11,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=37, state=RUNNABLE; CloseRegionProcedure 37b2ef2266aba1094eab2784dd808274, server=jenkins-hbase4.apache.org,46391,1676836800423}] 2023-02-19 20:00:11,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure ba93d94e14622472df062907637943de, server=jenkins-hbase4.apache.org,37601,1676836800374}] 2023-02-19 20:00:11,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:12,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:12,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d15edcbc7cb2674444030e09dd5bfe4c, disabling compactions & flushes 2023-02-19 20:00:12,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:12,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:12,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. after waiting 0 ms 2023-02-19 20:00:12,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:12,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7235463d891746a453faec138077c473 2023-02-19 20:00:12,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7235463d891746a453faec138077c473, disabling compactions & flushes 2023-02-19 20:00:12,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:12,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:12,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. after waiting 0 ms 2023-02-19 20:00:12,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:12,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/7235463d891746a453faec138077c473/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c. 2023-02-19 20:00:12,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473. 2023-02-19 20:00:12,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d15edcbc7cb2674444030e09dd5bfe4c: 2023-02-19 20:00:12,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7235463d891746a453faec138077c473: 2023-02-19 20:00:12,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7235463d891746a453faec138077c473 2023-02-19 20:00:12,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:12,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d168b17c98bde6385f00e772f0499f5f, disabling compactions & flushes 2023-02-19 20:00:12,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:12,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:12,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. after waiting 0 ms 2023-02-19 20:00:12,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:12,059 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7235463d891746a453faec138077c473, regionState=CLOSED 2023-02-19 20:00:12,059 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676836803381.7235463d891746a453faec138077c473.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812059"}]},"ts":"1676836812059"} 2023-02-19 20:00:12,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:12,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:12,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 37b2ef2266aba1094eab2784dd808274, disabling compactions & flushes 2023-02-19 20:00:12,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:12,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:12,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. after waiting 0 ms 2023-02-19 20:00:12,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:12,060 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d15edcbc7cb2674444030e09dd5bfe4c, regionState=CLOSED 2023-02-19 20:00:12,060 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812060"}]},"ts":"1676836812060"} 2023-02-19 20:00:12,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=38 2023-02-19 20:00:12,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=38, state=SUCCESS; CloseRegionProcedure 7235463d891746a453faec138077c473, server=jenkins-hbase4.apache.org,37601,1676836800374 in 189 msec 2023-02-19 20:00:12,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=35 2023-02-19 20:00:12,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=35, state=SUCCESS; CloseRegionProcedure d15edcbc7cb2674444030e09dd5bfe4c, server=jenkins-hbase4.apache.org,46391,1676836800423 in 179 msec 2023-02-19 20:00:12,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7235463d891746a453faec138077c473, UNASSIGN in 205 msec 2023-02-19 20:00:12,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d15edcbc7cb2674444030e09dd5bfe4c, UNASSIGN in 207 msec 2023-02-19 20:00:12,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274. 2023-02-19 20:00:12,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 37b2ef2266aba1094eab2784dd808274: 2023-02-19 20:00:12,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f. 2023-02-19 20:00:12,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d168b17c98bde6385f00e772f0499f5f: 2023-02-19 20:00:12,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:12,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:12,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 832c81e26d05e3d747deeac06a6e038b, disabling compactions & flushes 2023-02-19 20:00:12,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:12,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:12,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. after waiting 0 ms 2023-02-19 20:00:12,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:12,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=37b2ef2266aba1094eab2784dd808274, regionState=CLOSED 2023-02-19 20:00:12,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812087"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812087"}]},"ts":"1676836812087"} 2023-02-19 20:00:12,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:12,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ba93d94e14622472df062907637943de 2023-02-19 20:00:12,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ba93d94e14622472df062907637943de, disabling compactions & flushes 2023-02-19 20:00:12,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:12,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:12,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. after waiting 0 ms 2023-02-19 20:00:12,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:12,089 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d168b17c98bde6385f00e772f0499f5f, regionState=CLOSED 2023-02-19 20:00:12,089 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812089"}]},"ts":"1676836812089"} 2023-02-19 20:00:12,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=37 2023-02-19 20:00:12,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=37, state=SUCCESS; CloseRegionProcedure 37b2ef2266aba1094eab2784dd808274, server=jenkins-hbase4.apache.org,46391,1676836800423 in 204 msec 2023-02-19 20:00:12,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=36 2023-02-19 20:00:12,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=37b2ef2266aba1094eab2784dd808274, UNASSIGN in 235 msec 2023-02-19 20:00:12,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=36, state=SUCCESS; CloseRegionProcedure d168b17c98bde6385f00e772f0499f5f, server=jenkins-hbase4.apache.org,37601,1676836800374 in 208 msec 2023-02-19 20:00:12,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d168b17c98bde6385f00e772f0499f5f, UNASSIGN in 237 msec 2023-02-19 20:00:12,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 20:00:12,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 20:00:12,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b. 2023-02-19 20:00:12,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 832c81e26d05e3d747deeac06a6e038b: 2023-02-19 20:00:12,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de. 2023-02-19 20:00:12,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ba93d94e14622472df062907637943de: 2023-02-19 20:00:12,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:12,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:12,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 28dce26a123d894bb24f763c1dcff071, disabling compactions & flushes 2023-02-19 20:00:12,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:12,120 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=832c81e26d05e3d747deeac06a6e038b, regionState=CLOSED 2023-02-19 20:00:12,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:12,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. after waiting 0 ms 2023-02-19 20:00:12,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:12,120 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836812120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812120"}]},"ts":"1676836812120"} 2023-02-19 20:00:12,121 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=ba93d94e14622472df062907637943de, regionState=CLOSED 2023-02-19 20:00:12,121 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836812121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812121"}]},"ts":"1676836812121"} 2023-02-19 20:00:12,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ba93d94e14622472df062907637943de 2023-02-19 20:00:12,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:12,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2dab961d0af4317acbd9859c0d1b5ba4, disabling compactions & flushes 2023-02-19 20:00:12,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:12,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:12,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. after waiting 0 ms 2023-02-19 20:00:12,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:12,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-19 20:00:12,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 832c81e26d05e3d747deeac06a6e038b, server=jenkins-hbase4.apache.org,46391,1676836800423 in 251 msec 2023-02-19 20:00:12,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-19 20:00:12,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure ba93d94e14622472df062907637943de, server=jenkins-hbase4.apache.org,37601,1676836800374 in 236 msec 2023-02-19 20:00:12,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=832c81e26d05e3d747deeac06a6e038b, UNASSIGN in 266 msec 2023-02-19 20:00:12,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ba93d94e14622472df062907637943de, UNASSIGN in 269 msec 2023-02-19 20:00:12,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071. 2023-02-19 20:00:12,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4. 2023-02-19 20:00:12,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 28dce26a123d894bb24f763c1dcff071: 2023-02-19 20:00:12,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2dab961d0af4317acbd9859c0d1b5ba4: 2023-02-19 20:00:12,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:12,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:12,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:12,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c34bea63a85f971bab08616425dd7c3, disabling compactions & flushes 2023-02-19 20:00:12,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:12,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:12,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. after waiting 0 ms 2023-02-19 20:00:12,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:12,158 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=2dab961d0af4317acbd9859c0d1b5ba4, regionState=CLOSED 2023-02-19 20:00:12,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:12,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:12,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2db37fc62020b472c0c8c4c1bf89bdb1, disabling compactions & flushes 2023-02-19 20:00:12,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:12,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:12,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. after waiting 0 ms 2023-02-19 20:00:12,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:12,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812158"}]},"ts":"1676836812158"} 2023-02-19 20:00:12,160 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=28dce26a123d894bb24f763c1dcff071, regionState=CLOSED 2023-02-19 20:00:12,160 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812160"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812160"}]},"ts":"1676836812160"} 2023-02-19 20:00:12,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=41 2023-02-19 20:00:12,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=41, state=SUCCESS; CloseRegionProcedure 2dab961d0af4317acbd9859c0d1b5ba4, server=jenkins-hbase4.apache.org,37601,1676836800374 in 295 msec 2023-02-19 20:00:12,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2dab961d0af4317acbd9859c0d1b5ba4, UNASSIGN in 308 msec 2023-02-19 20:00:12,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3. 2023-02-19 20:00:12,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c34bea63a85f971bab08616425dd7c3: 2023-02-19 20:00:12,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:12,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=42 2023-02-19 20:00:12,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=42, state=SUCCESS; CloseRegionProcedure 28dce26a123d894bb24f763c1dcff071, server=jenkins-hbase4.apache.org,46391,1676836800423 in 289 msec 2023-02-19 20:00:12,178 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9c34bea63a85f971bab08616425dd7c3, regionState=CLOSED 2023-02-19 20:00:12,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812178"}]},"ts":"1676836812178"} 2023-02-19 20:00:12,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:12,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=28dce26a123d894bb24f763c1dcff071, UNASSIGN in 319 msec 2023-02-19 20:00:12,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1. 2023-02-19 20:00:12,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2db37fc62020b472c0c8c4c1bf89bdb1: 2023-02-19 20:00:12,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:12,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2db37fc62020b472c0c8c4c1bf89bdb1, regionState=CLOSED 2023-02-19 20:00:12,183 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836812183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836812183"}]},"ts":"1676836812183"} 2023-02-19 20:00:12,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-19 20:00:12,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure 9c34bea63a85f971bab08616425dd7c3, server=jenkins-hbase4.apache.org,37601,1676836800374 in 311 msec 2023-02-19 20:00:12,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c34bea63a85f971bab08616425dd7c3, UNASSIGN in 326 msec 2023-02-19 20:00:12,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-19 20:00:12,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure 2db37fc62020b472c0c8c4c1bf89bdb1, server=jenkins-hbase4.apache.org,46391,1676836800423 in 316 msec 2023-02-19 20:00:12,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=33 2023-02-19 20:00:12,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2db37fc62020b472c0c8c4c1bf89bdb1, UNASSIGN in 329 msec 2023-02-19 20:00:12,190 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836812190"}]},"ts":"1676836812190"} 2023-02-19 20:00:12,192 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-19 20:00:12,194 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-19 20:00:12,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 352 msec 2023-02-19 20:00:12,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:12,460 INFO [Listener at localhost/34167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-19 20:00:12,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-19 20:00:12,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:12,476 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:12,478 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:12,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:12,493 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:12,492 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:12,498 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/recovered.edits] 2023-02-19 20:00:12,499 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/recovered.edits] 2023-02-19 20:00:12,499 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/recovered.edits] 2023-02-19 20:00:12,499 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/recovered.edits] 2023-02-19 20:00:12,499 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/recovered.edits] 2023-02-19 20:00:12,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/recovered.edits] 2023-02-19 20:00:12,500 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/recovered.edits] 2023-02-19 20:00:12,502 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/recovered.edits] 2023-02-19 20:00:12,517 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/ac015076e64a4b5994974320522d456e to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/ac015076e64a4b5994974320522d456e 2023-02-19 20:00:12,518 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/3fdcac3666b840889a1a7216480f375e to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/3fdcac3666b840889a1a7216480f375e 2023-02-19 20:00:12,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/8a10e347d51442238229e492f95eda3b to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/8a10e347d51442238229e492f95eda3b 2023-02-19 20:00:12,520 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/be10315d79cf43a99fcec403aea51636 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/be10315d79cf43a99fcec403aea51636 2023-02-19 20:00:12,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/483a4aa17a794250bd0ef8dd9022b07c to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/483a4aa17a794250bd0ef8dd9022b07c 2023-02-19 20:00:12,523 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/af06af41b027458d8257793fbed19846 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/af06af41b027458d8257793fbed19846 2023-02-19 20:00:12,524 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/9e8c8d0ebf694c90abf9d2c812f3125a to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/9e8c8d0ebf694c90abf9d2c812f3125a 2023-02-19 20:00:12,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/b7d098e70cb646f9943f647e097e99b7 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f1/b7d098e70cb646f9943f647e097e99b7 2023-02-19 20:00:12,526 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/d7d6329f648e4ff99346a3e914208451 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f1/d7d6329f648e4ff99346a3e914208451 2023-02-19 20:00:12,526 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/f697c86cf0f84e2492703fb9f224f32a to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f1/f697c86cf0f84e2492703fb9f224f32a 2023-02-19 20:00:12,526 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/7b5736c062154645b07ba6a3a1650303 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f1/7b5736c062154645b07ba6a3a1650303 2023-02-19 20:00:12,526 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/8d947894b0f64cefa07bb0ef4b9a4b56 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f1/8d947894b0f64cefa07bb0ef4b9a4b56 2023-02-19 20:00:12,528 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/e00f95984c2c49f3a7ce21c9508f19ad to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f1/e00f95984c2c49f3a7ce21c9508f19ad 2023-02-19 20:00:12,529 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/recovered.edits/6.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/ba93d94e14622472df062907637943de/recovered.edits/6.seqid 2023-02-19 20:00:12,529 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/e65fdfb2c3f64ea89825291cdccceb58 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f1/e65fdfb2c3f64ea89825291cdccceb58 2023-02-19 20:00:12,533 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/ba93d94e14622472df062907637943de 2023-02-19 20:00:12,533 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:12,543 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/c497e8a2d2f24aa4a605f9efeddb297a to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/c497e8a2d2f24aa4a605f9efeddb297a 2023-02-19 20:00:12,544 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/59e59494d491446eb7cd0d8e2ac5b2b6 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/59e59494d491446eb7cd0d8e2ac5b2b6 2023-02-19 20:00:12,544 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/9aa20e4b31b4427ab9fa6d9ab7e02460 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/9aa20e4b31b4427ab9fa6d9ab7e02460 2023-02-19 20:00:12,544 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/2f231bd596f340d9abddcaf646f95710 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/2f231bd596f340d9abddcaf646f95710 2023-02-19 20:00:12,545 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/d95309bbbbaf4d299f8a9366a0be529c to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/d95309bbbbaf4d299f8a9366a0be529c 2023-02-19 20:00:12,547 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/recovered.edits] 2023-02-19 20:00:12,547 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/d661e3eda3ab4a7fa32d1a18acb3bcdb to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/d661e3eda3ab4a7fa32d1a18acb3bcdb 2023-02-19 20:00:12,547 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/410df5722a9e4276a9aa2ada077060f7 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/410df5722a9e4276a9aa2ada077060f7 2023-02-19 20:00:12,548 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/db0ead62b3494fc4a1d4f5aaf8069665 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/f2/db0ead62b3494fc4a1d4f5aaf8069665 2023-02-19 20:00:12,549 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/ff87b8db8d0c49ba927e8dd538c5b824 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/f2/ff87b8db8d0c49ba927e8dd538c5b824 2023-02-19 20:00:12,550 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/b81e3836d487492f87202041fc897d9f to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/7235463d891746a453faec138077c473/f2/b81e3836d487492f87202041fc897d9f 2023-02-19 20:00:12,552 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/e705b0ca56d84ebb8fbce0caf2cd1fe1 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/f2/e705b0ca56d84ebb8fbce0caf2cd1fe1 2023-02-19 20:00:12,553 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/d4ada6ea9e5d4329adbdd3af945a139e to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/f2/d4ada6ea9e5d4329adbdd3af945a139e 2023-02-19 20:00:12,553 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/c8097613a9474d63bce7c660ac4b65c5 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/f2/c8097613a9474d63bce7c660ac4b65c5 2023-02-19 20:00:12,555 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/ea63a0be33c24b5893eecb0185bb316a to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/f2/ea63a0be33c24b5893eecb0185bb316a 2023-02-19 20:00:12,560 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3/recovered.edits/12.seqid 2023-02-19 20:00:12,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/7235463d891746a453faec138077c473/recovered.edits/12.seqid 2023-02-19 20:00:12,562 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/9c34bea63a85f971bab08616425dd7c3 2023-02-19 20:00:12,562 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:12,564 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4/recovered.edits/12.seqid 2023-02-19 20:00:12,564 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/7235463d891746a453faec138077c473 2023-02-19 20:00:12,564 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/0f36151543644b158dd29a5d5e8ec282 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/0f36151543644b158dd29a5d5e8ec282 2023-02-19 20:00:12,565 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2dab961d0af4317acbd9859c0d1b5ba4 2023-02-19 20:00:12,566 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c/recovered.edits/12.seqid 2023-02-19 20:00:12,566 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274/recovered.edits/12.seqid 2023-02-19 20:00:12,566 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f/recovered.edits/12.seqid 2023-02-19 20:00:12,567 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1/recovered.edits/12.seqid 2023-02-19 20:00:12,567 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d15edcbc7cb2674444030e09dd5bfe4c 2023-02-19 20:00:12,567 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/37b2ef2266aba1094eab2784dd808274 2023-02-19 20:00:12,568 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/d168b17c98bde6385f00e772f0499f5f 2023-02-19 20:00:12,568 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f1, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/f2, FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/recovered.edits] 2023-02-19 20:00:12,568 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/2db37fc62020b472c0c8c4c1bf89bdb1 2023-02-19 20:00:12,573 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/3d626cf539f04d9593ae648bacd745cf to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f1/3d626cf539f04d9593ae648bacd745cf 2023-02-19 20:00:12,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 20:00:12,584 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0895f6defcd04d05bc43956dceb6a425 to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0895f6defcd04d05bc43956dceb6a425 2023-02-19 20:00:12,593 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0c8a7262cd4d4d43a6df59a989fc91ba to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/f2/0c8a7262cd4d4d43a6df59a989fc91ba 2023-02-19 20:00:12,594 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/recovered.edits/6.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b/recovered.edits/6.seqid 2023-02-19 20:00:12,595 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/832c81e26d05e3d747deeac06a6e038b 2023-02-19 20:00:12,598 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/recovered.edits/12.seqid to hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/archive/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071/recovered.edits/12.seqid 2023-02-19 20:00:12,599 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/.tmp/data/default/testWithMapReduce/28dce26a123d894bb24f763c1dcff071 2023-02-19 20:00:12,599 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 20:00:12,606 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:12,635 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-19 20:00:12,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-19 20:00:12,641 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:12,641 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676836803381.7235463d891746a453faec138077c473.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836812642"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,647 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-19 20:00:12,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba93d94e14622472df062907637943de, NAME => 'testWithMapReduce,,1676836803381.ba93d94e14622472df062907637943de.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => d15edcbc7cb2674444030e09dd5bfe4c, NAME => 'testWithMapReduce,aaa,1676836803381.d15edcbc7cb2674444030e09dd5bfe4c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => d168b17c98bde6385f00e772f0499f5f, NAME => 'testWithMapReduce,d\x84\x84,1676836803381.d168b17c98bde6385f00e772f0499f5f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 37b2ef2266aba1094eab2784dd808274, NAME => 'testWithMapReduce,g\xA7\xA7,1676836803381.37b2ef2266aba1094eab2784dd808274.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 7235463d891746a453faec138077c473, NAME => 'testWithMapReduce,j\xCA\xCA,1676836803381.7235463d891746a453faec138077c473.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2db37fc62020b472c0c8c4c1bf89bdb1, NAME => 'testWithMapReduce,m\xED\xED,1676836803381.2db37fc62020b472c0c8c4c1bf89bdb1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9c34bea63a85f971bab08616425dd7c3, NAME => 'testWithMapReduce,q\x11\x10,1676836803381.9c34bea63a85f971bab08616425dd7c3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 2dab961d0af4317acbd9859c0d1b5ba4, NAME => 'testWithMapReduce,t43,1676836803381.2dab961d0af4317acbd9859c0d1b5ba4.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 28dce26a123d894bb24f763c1dcff071, NAME => 'testWithMapReduce,wWV,1676836803381.28dce26a123d894bb24f763c1dcff071.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 832c81e26d05e3d747deeac06a6e038b, NAME => 'testWithMapReduce,zz{,1676836803381.832c81e26d05e3d747deeac06a6e038b.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-19 20:00:12,648 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-19 20:00:12,648 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676836812648"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:12,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-19 20:00:12,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:12,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 189 msec 2023-02-19 20:00:12,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45653] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 20:00:12,783 INFO [Listener at localhost/34167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-19 20:00:12,784 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:12,784 INFO [Listener at localhost/34167] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:12,784 DEBUG [Listener at localhost/34167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a711c8e to 127.0.0.1:60266 2023-02-19 20:00:12,784 DEBUG [Listener at localhost/34167] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:12,784 DEBUG [Listener at localhost/34167] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:12,784 DEBUG [Listener at localhost/34167] util.JVMClusterUtil(257): Found active master hash=87256231, stopped=false 2023-02-19 20:00:12,784 INFO [Listener at localhost/34167] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:12,787 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:12,787 INFO [Listener at localhost/34167] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:12,787 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:12,787 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:12,788 DEBUG [Listener at localhost/34167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01dc5a09 to 127.0.0.1:60266 2023-02-19 20:00:12,789 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:12,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:12,789 DEBUG [Listener at localhost/34167] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:12,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:12,789 INFO [Listener at localhost/34167] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37601,1676836800374' ***** 2023-02-19 20:00:12,789 INFO [Listener at localhost/34167] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:12,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:12,790 INFO [RS:0;jenkins-hbase4:37601] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:12,789 INFO [Listener at localhost/34167] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46391,1676836800423' ***** 2023-02-19 20:00:12,790 INFO [Listener at localhost/34167] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:12,790 INFO [RS:0;jenkins-hbase4:37601] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:12,790 INFO [RS:0;jenkins-hbase4:37601] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:12,791 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(3304): Received CLOSE for 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:12,791 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:12,791 DEBUG [RS:0;jenkins-hbase4:37601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24e10509 to 127.0.0.1:60266 2023-02-19 20:00:12,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f4d4ce2f02c0040a4eaa238fd76b2c8, disabling compactions & flushes 2023-02-19 20:00:12,790 INFO [RS:1;jenkins-hbase4:46391] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:12,792 INFO [RS:1;jenkins-hbase4:46391] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:12,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:12,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:12,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. after waiting 0 ms 2023-02-19 20:00:12,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:12,792 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:12,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3f4d4ce2f02c0040a4eaa238fd76b2c8 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:12,792 DEBUG [RS:0;jenkins-hbase4:37601] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:12,792 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:12,792 INFO [RS:1;jenkins-hbase4:46391] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:12,793 INFO [RS:0;jenkins-hbase4:37601] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:12,793 INFO [RS:0;jenkins-hbase4:37601] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:12,794 INFO [RS:0;jenkins-hbase4:37601] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:12,793 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:12,794 DEBUG [RS:1;jenkins-hbase4:46391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58ecfb27 to 127.0.0.1:60266 2023-02-19 20:00:12,794 DEBUG [RS:1;jenkins-hbase4:46391] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:12,794 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46391,1676836800423; all regions closed. 2023-02-19 20:00:12,794 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:12,794 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 20:00:12,795 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 3f4d4ce2f02c0040a4eaa238fd76b2c8=hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8.} 2023-02-19 20:00:12,796 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:12,796 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:12,796 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:12,796 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:12,796 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:12,796 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-19 20:00:12,797 DEBUG [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1505): Waiting on 1588230740, 3f4d4ce2f02c0040a4eaa238fd76b2c8 2023-02-19 20:00:12,806 DEBUG [RS:1;jenkins-hbase4:46391] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/oldWALs 2023-02-19 20:00:12,806 INFO [RS:1;jenkins-hbase4:46391] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46391%2C1676836800423:(num 1676836802847) 2023-02-19 20:00:12,806 DEBUG [RS:1;jenkins-hbase4:46391] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:12,806 INFO [RS:1;jenkins-hbase4:46391] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:12,807 INFO [RS:1;jenkins-hbase4:46391] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:12,807 INFO [RS:1;jenkins-hbase4:46391] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:12,807 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:12,807 INFO [RS:1;jenkins-hbase4:46391] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:12,807 INFO [RS:1;jenkins-hbase4:46391] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:12,808 INFO [RS:1;jenkins-hbase4:46391] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46391 2023-02-19 20:00:12,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/.tmp/info/6ec774693b7a4a698033a1e64ef6834d 2023-02-19 20:00:12,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/.tmp/info/19f82b00f00c479c8fde7d5ab51f3d13 2023-02-19 20:00:12,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/.tmp/info/6ec774693b7a4a698033a1e64ef6834d as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/info/6ec774693b7a4a698033a1e64ef6834d 2023-02-19 20:00:12,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/info/6ec774693b7a4a698033a1e64ef6834d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:12,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3f4d4ce2f02c0040a4eaa238fd76b2c8 in 47ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:12,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19f82b00f00c479c8fde7d5ab51f3d13 2023-02-19 20:00:12,852 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:12,853 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/namespace/3f4d4ce2f02c0040a4eaa238fd76b2c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:12,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:12,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f4d4ce2f02c0040a4eaa238fd76b2c8: 2023-02-19 20:00:12,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836802466.3f4d4ce2f02c0040a4eaa238fd76b2c8. 2023-02-19 20:00:12,894 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/.tmp/rep_barrier/69021a9a1cd64ba5838e004301761fd0 2023-02-19 20:00:12,900 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:12,900 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:12,900 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:12,900 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46391,1676836800423 2023-02-19 20:00:12,901 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16481ece rejected from java.util.concurrent.ThreadPoolExecutor@127788df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:12,901 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:12,901 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3080072f rejected from java.util.concurrent.ThreadPoolExecutor@127788df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:12,903 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46391,1676836800423] 2023-02-19 20:00:12,903 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46391,1676836800423; numProcessing=1 2023-02-19 20:00:12,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69021a9a1cd64ba5838e004301761fd0 2023-02-19 20:00:12,905 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46391,1676836800423 already deleted, retry=false 2023-02-19 20:00:12,905 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46391,1676836800423 expired; onlineServers=1 2023-02-19 20:00:12,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/.tmp/table/bc4d5ec35e9840cc9c1548db700954a3 2023-02-19 20:00:12,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc4d5ec35e9840cc9c1548db700954a3 2023-02-19 20:00:12,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/.tmp/info/19f82b00f00c479c8fde7d5ab51f3d13 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/info/19f82b00f00c479c8fde7d5ab51f3d13 2023-02-19 20:00:12,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 19f82b00f00c479c8fde7d5ab51f3d13 2023-02-19 20:00:12,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/info/19f82b00f00c479c8fde7d5ab51f3d13, entries=30, sequenceid=57, filesize=7.9 K 2023-02-19 20:00:12,936 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/.tmp/rep_barrier/69021a9a1cd64ba5838e004301761fd0 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/rep_barrier/69021a9a1cd64ba5838e004301761fd0 2023-02-19 20:00:12,942 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69021a9a1cd64ba5838e004301761fd0 2023-02-19 20:00:12,942 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/rep_barrier/69021a9a1cd64ba5838e004301761fd0, entries=10, sequenceid=57, filesize=5.9 K 2023-02-19 20:00:12,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/.tmp/table/bc4d5ec35e9840cc9c1548db700954a3 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/table/bc4d5ec35e9840cc9c1548db700954a3 2023-02-19 20:00:12,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc4d5ec35e9840cc9c1548db700954a3 2023-02-19 20:00:12,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/table/bc4d5ec35e9840cc9c1548db700954a3, entries=13, sequenceid=57, filesize=5.9 K 2023-02-19 20:00:12,951 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 155ms, sequenceid=57, compaction requested=false 2023-02-19 20:00:12,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-19 20:00:12,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:12,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:12,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:12,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:12,997 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37601,1676836800374; all regions closed. 2023-02-19 20:00:13,005 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:13,005 INFO [RS:1;jenkins-hbase4:46391] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46391,1676836800423; zookeeper connection closed. 2023-02-19 20:00:13,005 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48f78ced rejected from java.util.concurrent.ThreadPoolExecutor@127788df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,006 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:46391-0x1006e2ae8fe0002, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:13,006 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7532b01 rejected from java.util.concurrent.ThreadPoolExecutor@127788df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,006 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37ff5a48] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37ff5a48 2023-02-19 20:00:13,008 DEBUG [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/oldWALs 2023-02-19 20:00:13,008 INFO [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37601%2C1676836800374.meta:.meta(num 1676836802146) 2023-02-19 20:00:13,014 DEBUG [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/oldWALs 2023-02-19 20:00:13,014 INFO [RS:0;jenkins-hbase4:37601] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37601%2C1676836800374:(num 1676836802847) 2023-02-19 20:00:13,014 DEBUG [RS:0;jenkins-hbase4:37601] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:13,014 INFO [RS:0;jenkins-hbase4:37601] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:13,014 INFO [RS:0;jenkins-hbase4:37601] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:13,015 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:13,015 INFO [RS:0;jenkins-hbase4:37601] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37601 2023-02-19 20:00:13,019 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37601,1676836800374 2023-02-19 20:00:13,019 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42f3ec43 rejected from java.util.concurrent.ThreadPoolExecutor@46cc60c5[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,019 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:13,020 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37601,1676836800374] 2023-02-19 20:00:13,020 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37601,1676836800374; numProcessing=2 2023-02-19 20:00:13,026 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37601,1676836800374 already deleted, retry=false 2023-02-19 20:00:13,026 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37601,1676836800374 expired; onlineServers=0 2023-02-19 20:00:13,026 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45653,1676836799180' ***** 2023-02-19 20:00:13,026 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:13,026 DEBUG [M:0;jenkins-hbase4:45653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440e669c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:13,027 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45653,1676836799180 2023-02-19 20:00:13,027 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45653,1676836799180; all regions closed. 2023-02-19 20:00:13,027 DEBUG [M:0;jenkins-hbase4:45653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:13,027 DEBUG [M:0;jenkins-hbase4:45653] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:13,027 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:13,027 DEBUG [M:0;jenkins-hbase4:45653] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:13,027 INFO [M:0;jenkins-hbase4:45653] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:13,027 INFO [M:0;jenkins-hbase4:45653] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:13,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836801600] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836801600,5,FailOnTimeoutGroup] 2023-02-19 20:00:13,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836801600] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836801600,5,FailOnTimeoutGroup] 2023-02-19 20:00:13,027 INFO [M:0;jenkins-hbase4:45653] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:13,028 DEBUG [M:0;jenkins-hbase4:45653] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:13,028 INFO [M:0;jenkins-hbase4:45653] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:13,029 ERROR [M:0;jenkins-hbase4:45653] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-19 20:00:13,030 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:13,030 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:13,030 INFO [M:0;jenkins-hbase4:45653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:13,030 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:13,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:13,031 DEBUG [M:0;jenkins-hbase4:45653] zookeeper.ZKUtil(398): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:13,031 WARN [M:0;jenkins-hbase4:45653] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:13,031 INFO [M:0;jenkins-hbase4:45653] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:13,032 INFO [M:0;jenkins-hbase4:45653] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:13,032 DEBUG [M:0;jenkins-hbase4:45653] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:13,032 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:13,032 DEBUG [M:0;jenkins-hbase4:45653] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:13,032 DEBUG [M:0;jenkins-hbase4:45653] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:13,033 DEBUG [M:0;jenkins-hbase4:45653] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:13,033 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.19 KB 2023-02-19 20:00:13,053 INFO [M:0;jenkins-hbase4:45653] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/df912102dbf84c4192de1c0f3841dae3 2023-02-19 20:00:13,060 DEBUG [M:0;jenkins-hbase4:45653] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/df912102dbf84c4192de1c0f3841dae3 as hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/df912102dbf84c4192de1c0f3841dae3 2023-02-19 20:00:13,065 INFO [M:0;jenkins-hbase4:45653] regionserver.HStore(1080): Added hdfs://localhost:39291/user/jenkins/test-data/e596cec4-8bf7-b7b3-216b-3bdf2497e508/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/df912102dbf84c4192de1c0f3841dae3, entries=53, sequenceid=357, filesize=10.4 K 2023-02-19 20:00:13,066 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=357, compaction requested=false 2023-02-19 20:00:13,071 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:13,071 DEBUG [M:0;jenkins-hbase4:45653] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:13,077 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:13,077 INFO [M:0;jenkins-hbase4:45653] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:13,077 INFO [M:0;jenkins-hbase4:45653] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45653 2023-02-19 20:00:13,089 DEBUG [M:0;jenkins-hbase4:45653] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45653,1676836799180 already deleted, retry=false 2023-02-19 20:00:13,189 INFO [RS:0;jenkins-hbase4:37601] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37601,1676836800374; zookeeper connection closed. 2023-02-19 20:00:13,189 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:13,190 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fcb2c17 rejected from java.util.concurrent.ThreadPoolExecutor@46cc60c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,190 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@29ce93e2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@29ce93e2 2023-02-19 20:00:13,190 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): regionserver:37601-0x1006e2ae8fe0001, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:13,190 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1768d084 rejected from java.util.concurrent.ThreadPoolExecutor@46cc60c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,190 INFO [Listener at localhost/34167] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:13,290 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:13,290 INFO [M:0;jenkins-hbase4:45653] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45653,1676836799180; zookeeper connection closed. 2023-02-19 20:00:13,290 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ac865ce rejected from java.util.concurrent.ThreadPoolExecutor@2c4d1e16[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,290 DEBUG [Listener at localhost/34167-EventThread] zookeeper.ZKWatcher(600): master:45653-0x1006e2ae8fe0000, quorum=127.0.0.1:60266, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:13,290 ERROR [Listener at localhost/34167-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a4f439d rejected from java.util.concurrent.ThreadPoolExecutor@2c4d1e16[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:13,292 WARN [Listener at localhost/34167] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:13,298 INFO [Listener at localhost/34167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:13,402 WARN [BP-330768061-172.31.14.131-1676836795828 heartbeating to localhost/127.0.0.1:39291] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:13,402 WARN [BP-330768061-172.31.14.131-1676836795828 heartbeating to localhost/127.0.0.1:39291] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-330768061-172.31.14.131-1676836795828 (Datanode Uuid 62b7715f-874a-4710-b4b1-4a020b20aa35) service to localhost/127.0.0.1:39291 2023-02-19 20:00:13,405 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/dfs/data/data4/current/BP-330768061-172.31.14.131-1676836795828] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:13,405 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/dfs/data/data3/current/BP-330768061-172.31.14.131-1676836795828] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:13,407 WARN [Listener at localhost/34167] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:13,420 INFO [Listener at localhost/34167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:13,524 WARN [BP-330768061-172.31.14.131-1676836795828 heartbeating to localhost/127.0.0.1:39291] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:13,524 WARN [BP-330768061-172.31.14.131-1676836795828 heartbeating to localhost/127.0.0.1:39291] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-330768061-172.31.14.131-1676836795828 (Datanode Uuid 88365ac8-a411-414f-8f04-d01d7f33feab) service to localhost/127.0.0.1:39291 2023-02-19 20:00:13,525 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/dfs/data/data1/current/BP-330768061-172.31.14.131-1676836795828] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:13,525 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/cluster_da385089-57ad-1639-0089-092c6126a037/dfs/data/data2/current/BP-330768061-172.31.14.131-1676836795828] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:13,563 INFO [Listener at localhost/34167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:13,685 INFO [Listener at localhost/34167] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:13,764 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:13,780 INFO [Listener at localhost/34167] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:39291 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39291 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39291 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39291 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34167 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39291 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:39291 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39291 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45653,1676836799180)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@782e20ff java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=544 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=351 (was 220) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=9903 (was 11295) 2023-02-19 20:00:13,790 INFO [Listener at localhost/34167] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=544, MaxFileDescriptor=60000, SystemLoadAverage=351, ProcessCount=170, AvailableMemoryMB=9903 2023-02-19 20:00:13,805 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop.log.dir so I do NOT create it in target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194 2023-02-19 20:00:13,805 WARN [Listener at localhost/34167] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 20:00:13,805 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop.tmp.dir so I do NOT create it in target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194 2023-02-19 20:00:13,805 WARN [Listener at localhost/34167] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e30c7046-70fa-26df-a3e7-ef10153a5653/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 20:00:13,805 DEBUG [Listener at localhost/34167] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194 2023-02-19 20:00:13,805 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:00:13,805 INFO [Listener at localhost/34167] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a, deleteOnExit=true 2023-02-19 20:00:13,805 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:00:13,806 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/test.cache.data in system properties and HBase conf 2023-02-19 20:00:13,806 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:00:13,806 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:00:13,806 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:00:13,806 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:00:13,807 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:00:13,807 DEBUG [Listener at localhost/34167] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:00:13,807 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:13,807 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:13,808 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:00:13,808 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:13,808 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:00:13,808 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:00:13,808 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:13,808 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:13,809 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:00:13,809 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:00:13,809 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:00:13,809 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:13,809 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:00:13,809 INFO [Listener at localhost/34167] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:00:13,813 WARN [Listener at localhost/34167] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:13,813 WARN [Listener at localhost/34167] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:13,858 WARN [Listener at localhost/34167] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:13,860 INFO [Listener at localhost/34167] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:13,864 INFO [Listener at localhost/34167] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/java.io.tmpdir/Jetty_localhost_46185_hdfs____.5r41t6/webapp 2023-02-19 20:00:13,989 INFO [Listener at localhost/34167] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46185 2023-02-19 20:00:13,994 WARN [Listener at localhost/34167] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:13,994 WARN [Listener at localhost/34167] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:14,049 WARN [Listener at localhost/34463] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:14,077 WARN [Listener at localhost/34463] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:14,080 WARN [Listener at localhost/34463] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:14,081 INFO [Listener at localhost/34463] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:14,090 INFO [Listener at localhost/34463] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/java.io.tmpdir/Jetty_localhost_44061_datanode____.4mcysu/webapp 2023-02-19 20:00:14,195 INFO [Listener at localhost/34463] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44061 2023-02-19 20:00:14,204 WARN [Listener at localhost/40945] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:14,233 WARN [Listener at localhost/40945] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:14,237 WARN [Listener at localhost/40945] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:14,238 INFO [Listener at localhost/40945] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:14,244 INFO [Listener at localhost/40945] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/java.io.tmpdir/Jetty_localhost_40333_datanode____.mqggjm/webapp 2023-02-19 20:00:14,325 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe1e2c57192d949eb: Processing first storage report for DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24 from datanode a00e51db-a212-407a-8947-05058c2fd655 2023-02-19 20:00:14,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe1e2c57192d949eb: from storage DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24 node DatanodeRegistration(127.0.0.1:44871, datanodeUuid=a00e51db-a212-407a-8947-05058c2fd655, infoPort=44485, infoSecurePort=0, ipcPort=40945, storageInfo=lv=-57;cid=testClusterID;nsid=2069902706;c=1676836813816), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:14,325 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe1e2c57192d949eb: Processing first storage report for DS-b8ece0cd-74c5-4090-9fbd-c70ce0fe2521 from datanode a00e51db-a212-407a-8947-05058c2fd655 2023-02-19 20:00:14,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe1e2c57192d949eb: from storage DS-b8ece0cd-74c5-4090-9fbd-c70ce0fe2521 node DatanodeRegistration(127.0.0.1:44871, datanodeUuid=a00e51db-a212-407a-8947-05058c2fd655, infoPort=44485, infoSecurePort=0, ipcPort=40945, storageInfo=lv=-57;cid=testClusterID;nsid=2069902706;c=1676836813816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:14,363 INFO [Listener at localhost/40945] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40333 2023-02-19 20:00:14,380 WARN [Listener at localhost/36327] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:14,520 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4459e297cd4e2792: Processing first storage report for DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0 from datanode 27a6c4ca-716f-4713-8017-12fa6dd05204 2023-02-19 20:00:14,520 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4459e297cd4e2792: from storage DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0 node DatanodeRegistration(127.0.0.1:46367, datanodeUuid=27a6c4ca-716f-4713-8017-12fa6dd05204, infoPort=34361, infoSecurePort=0, ipcPort=36327, storageInfo=lv=-57;cid=testClusterID;nsid=2069902706;c=1676836813816), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:14,520 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4459e297cd4e2792: Processing first storage report for DS-d2b80011-e867-4f78-9e2d-5b0a5afb1e24 from datanode 27a6c4ca-716f-4713-8017-12fa6dd05204 2023-02-19 20:00:14,520 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4459e297cd4e2792: from storage DS-d2b80011-e867-4f78-9e2d-5b0a5afb1e24 node DatanodeRegistration(127.0.0.1:46367, datanodeUuid=27a6c4ca-716f-4713-8017-12fa6dd05204, infoPort=34361, infoSecurePort=0, ipcPort=36327, storageInfo=lv=-57;cid=testClusterID;nsid=2069902706;c=1676836813816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:14,601 DEBUG [Listener at localhost/36327] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194 2023-02-19 20:00:14,608 INFO [Listener at localhost/36327] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/zookeeper_0, clientPort=49975, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:00:14,610 INFO [Listener at localhost/36327] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49975 2023-02-19 20:00:14,610 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,612 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,635 INFO [Listener at localhost/36327] util.FSUtils(479): Created version file at hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d with version=8 2023-02-19 20:00:14,635 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,636 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,637 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/hbase-staging 2023-02-19 20:00:14,639 INFO [Listener at localhost/36327] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:14,639 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,639 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,639 INFO [Listener at localhost/36327] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:14,639 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,639 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:14,640 INFO [Listener at localhost/36327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:14,641 INFO [Listener at localhost/36327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35285 2023-02-19 20:00:14,642 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,643 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,644 INFO [Listener at localhost/36327] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35285 connecting to ZooKeeper ensemble=127.0.0.1:49975 2023-02-19 20:00:14,660 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:352850x0, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:14,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35285-0x1006e2b28d50000 connected 2023-02-19 20:00:14,683 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:14,684 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:14,684 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:14,685 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35285 2023-02-19 20:00:14,688 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35285 2023-02-19 20:00:14,692 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35285 2023-02-19 20:00:14,695 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35285 2023-02-19 20:00:14,696 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35285 2023-02-19 20:00:14,696 INFO [Listener at localhost/36327] master.HMaster(444): hbase.rootdir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d, hbase.cluster.distributed=false 2023-02-19 20:00:14,717 INFO [Listener at localhost/36327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:14,717 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,717 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,718 INFO [Listener at localhost/36327] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:14,718 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,718 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:14,718 INFO [Listener at localhost/36327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:14,723 INFO [Listener at localhost/36327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44625 2023-02-19 20:00:14,724 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:14,725 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:14,730 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,731 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,732 INFO [Listener at localhost/36327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44625 connecting to ZooKeeper ensemble=127.0.0.1:49975 2023-02-19 20:00:14,738 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:446250x0, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:14,739 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:446250x0, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:14,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44625-0x1006e2b28d50001 connected 2023-02-19 20:00:14,740 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:14,740 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:14,743 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44625 2023-02-19 20:00:14,744 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44625 2023-02-19 20:00:14,747 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44625 2023-02-19 20:00:14,748 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44625 2023-02-19 20:00:14,748 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44625 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:14,765 INFO [Listener at localhost/36327] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:14,767 INFO [Listener at localhost/36327] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39727 2023-02-19 20:00:14,768 INFO [Listener at localhost/36327] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:14,776 DEBUG [Listener at localhost/36327] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:14,777 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,778 INFO [Listener at localhost/36327] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,779 INFO [Listener at localhost/36327] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39727 connecting to ZooKeeper ensemble=127.0.0.1:49975 2023-02-19 20:00:14,783 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:397270x0, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:14,784 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:397270x0, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:14,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39727-0x1006e2b28d50002 connected 2023-02-19 20:00:14,785 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:14,785 DEBUG [Listener at localhost/36327] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:14,790 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39727 2023-02-19 20:00:14,790 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39727 2023-02-19 20:00:14,792 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39727 2023-02-19 20:00:14,794 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39727 2023-02-19 20:00:14,794 DEBUG [Listener at localhost/36327] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39727 2023-02-19 20:00:14,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:14,801 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:14,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:14,804 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:14,804 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:14,804 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:14,804 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:14,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:14,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35285,1676836814639 from backup master directory 2023-02-19 20:00:14,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:14,808 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:14,808 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:14,808 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:14,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:14,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/hbase.id with ID: a1029f1b-43d2-4e81-a98d-671c25e87aa8 2023-02-19 20:00:14,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:14,856 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:14,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x309719a9 to 127.0.0.1:49975 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:14,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d083975, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:14,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:14,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:14,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:14,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store-tmp 2023-02-19 20:00:14,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:14,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:14,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:14,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:14,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:14,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:14,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:14,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:14,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/WALs/jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:14,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35285%2C1676836814639, suffix=, logDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/WALs/jenkins-hbase4.apache.org,35285,1676836814639, archiveDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:14,924 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK] 2023-02-19 20:00:14,927 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK] 2023-02-19 20:00:14,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/WALs/jenkins-hbase4.apache.org,35285,1676836814639/jenkins-hbase4.apache.org%2C35285%2C1676836814639.1676836814902 2023-02-19 20:00:14,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK], DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK]] 2023-02-19 20:00:14,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:14,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:14,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:14,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:14,948 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:14,950 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:14,950 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:14,951 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:14,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:14,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:14,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:14,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:14,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74568050, jitterRate=0.11115053296089172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:14,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:14,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:14,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:14,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:14,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:14,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 20:00:14,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 20:00:14,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:14,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:14,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:14,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:14,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:14,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:14,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:14,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:14,988 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:14,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:14,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:14,991 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:14,991 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:14,991 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:14,991 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:14,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35285,1676836814639, sessionid=0x1006e2b28d50000, setting cluster-up flag (Was=false) 2023-02-19 20:00:14,997 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:15,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:15,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:15,006 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:15,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:15,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:15,021 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.hbase-snapshot/.tmp 2023-02-19 20:00:15,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:15,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:15,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:15,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:15,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:15,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:15,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:15,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836845026 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:15,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:15,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:15,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:15,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:15,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:15,032 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:15,032 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:15,034 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:15,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836815032,5,FailOnTimeoutGroup] 2023-02-19 20:00:15,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836815035,5,FailOnTimeoutGroup] 2023-02-19 20:00:15,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:15,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,050 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:15,050 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:15,051 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d 2023-02-19 20:00:15,062 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:15,063 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:15,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/info 2023-02-19 20:00:15,070 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:15,072 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:15,072 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:15,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:15,074 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:15,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:15,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:15,078 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/table 2023-02-19 20:00:15,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:15,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:15,081 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740 2023-02-19 20:00:15,082 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740 2023-02-19 20:00:15,089 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:15,092 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:15,100 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(952): ClusterId : a1029f1b-43d2-4e81-a98d-671c25e87aa8 2023-02-19 20:00:15,100 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:15,107 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:15,108 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65683976, jitterRate=-0.0212324857711792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:15,108 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:15,108 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:15,108 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:15,108 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:15,108 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:15,108 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:15,109 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:15,109 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:15,109 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(952): ClusterId : a1029f1b-43d2-4e81-a98d-671c25e87aa8 2023-02-19 20:00:15,110 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:15,110 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:15,110 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:15,113 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:15,115 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:15,115 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:15,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:15,117 DEBUG [RS:0;jenkins-hbase4:44625] zookeeper.ReadOnlyZKClient(139): Connect 0x62ca5a72 to 127.0.0.1:49975 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:15,118 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:15,123 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:15,123 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:15,131 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:15,137 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:15,139 DEBUG [RS:1;jenkins-hbase4:39727] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2f2e48 to 127.0.0.1:49975 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:15,139 DEBUG [RS:0;jenkins-hbase4:44625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c0da85b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:15,139 DEBUG [RS:0;jenkins-hbase4:44625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68323102, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:15,152 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44625 2023-02-19 20:00:15,153 INFO [RS:0;jenkins-hbase4:44625] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:15,153 INFO [RS:0;jenkins-hbase4:44625] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:15,153 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:15,155 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35285,1676836814639 with isa=jenkins-hbase4.apache.org/172.31.14.131:44625, startcode=1676836814716 2023-02-19 20:00:15,155 DEBUG [RS:0;jenkins-hbase4:44625] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:15,160 DEBUG [RS:1;jenkins-hbase4:39727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73e8df9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:15,160 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57293, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:15,160 DEBUG [RS:1;jenkins-hbase4:39727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77d74538, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:15,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,163 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d 2023-02-19 20:00:15,163 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34463 2023-02-19 20:00:15,163 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:15,164 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:15,164 DEBUG [RS:0;jenkins-hbase4:44625] zookeeper.ZKUtil(162): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,164 WARN [RS:0;jenkins-hbase4:44625] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:15,165 INFO [RS:0;jenkins-hbase4:44625] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:15,165 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,168 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44625,1676836814716] 2023-02-19 20:00:15,173 DEBUG [RS:0;jenkins-hbase4:44625] zookeeper.ZKUtil(162): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,174 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:15,174 INFO [RS:0;jenkins-hbase4:44625] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:15,175 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39727 2023-02-19 20:00:15,175 INFO [RS:1;jenkins-hbase4:39727] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:15,175 INFO [RS:1;jenkins-hbase4:39727] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:15,175 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:15,176 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35285,1676836814639 with isa=jenkins-hbase4.apache.org/172.31.14.131:39727, startcode=1676836814764 2023-02-19 20:00:15,176 DEBUG [RS:1;jenkins-hbase4:39727] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:15,180 INFO [RS:0;jenkins-hbase4:44625] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:15,180 INFO [RS:0;jenkins-hbase4:44625] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:15,181 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,182 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:15,184 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,184 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58793, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:15,184 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,184 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,184 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,184 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,185 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,185 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:15,185 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,185 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,185 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,185 DEBUG [RS:0;jenkins-hbase4:44625] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,186 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,186 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,186 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,186 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d 2023-02-19 20:00:15,186 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34463 2023-02-19 20:00:15,186 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:15,191 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:15,191 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:15,192 DEBUG [RS:1;jenkins-hbase4:39727] zookeeper.ZKUtil(162): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,192 WARN [RS:1;jenkins-hbase4:39727] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:15,192 INFO [RS:1;jenkins-hbase4:39727] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:15,192 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,192 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39727,1676836814764] 2023-02-19 20:00:15,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,201 DEBUG [RS:1;jenkins-hbase4:39727] zookeeper.ZKUtil(162): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,202 DEBUG [RS:1;jenkins-hbase4:39727] zookeeper.ZKUtil(162): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,203 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:15,203 INFO [RS:0;jenkins-hbase4:44625] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:15,203 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44625,1676836814716-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,203 INFO [RS:1;jenkins-hbase4:39727] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:15,205 INFO [RS:1;jenkins-hbase4:39727] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:15,206 INFO [RS:1;jenkins-hbase4:39727] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:15,206 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,206 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:15,207 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,208 DEBUG [RS:1;jenkins-hbase4:39727] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:15,213 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,213 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,213 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,218 INFO [RS:0;jenkins-hbase4:44625] regionserver.Replication(203): jenkins-hbase4.apache.org,44625,1676836814716 started 2023-02-19 20:00:15,218 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44625,1676836814716, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44625, sessionid=0x1006e2b28d50001 2023-02-19 20:00:15,218 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:15,218 DEBUG [RS:0;jenkins-hbase4:44625] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,218 DEBUG [RS:0;jenkins-hbase4:44625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44625,1676836814716' 2023-02-19 20:00:15,218 DEBUG [RS:0;jenkins-hbase4:44625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44625,1676836814716' 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:15,219 DEBUG [RS:0;jenkins-hbase4:44625] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:15,220 DEBUG [RS:0;jenkins-hbase4:44625] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:15,220 INFO [RS:0;jenkins-hbase4:44625] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:15,220 INFO [RS:0;jenkins-hbase4:44625] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:15,231 INFO [RS:1;jenkins-hbase4:39727] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:15,231 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39727,1676836814764-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,246 INFO [RS:1;jenkins-hbase4:39727] regionserver.Replication(203): jenkins-hbase4.apache.org,39727,1676836814764 started 2023-02-19 20:00:15,246 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39727,1676836814764, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39727, sessionid=0x1006e2b28d50002 2023-02-19 20:00:15,246 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39727,1676836814764' 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:15,247 DEBUG [RS:1;jenkins-hbase4:39727] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:15,248 DEBUG [RS:1;jenkins-hbase4:39727] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39727,1676836814764' 2023-02-19 20:00:15,248 DEBUG [RS:1;jenkins-hbase4:39727] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:15,248 DEBUG [RS:1;jenkins-hbase4:39727] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:15,248 DEBUG [RS:1;jenkins-hbase4:39727] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:15,248 INFO [RS:1;jenkins-hbase4:39727] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:15,248 INFO [RS:1;jenkins-hbase4:39727] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:15,281 DEBUG [jenkins-hbase4:35285] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:15,281 DEBUG [jenkins-hbase4:35285] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:15,283 DEBUG [jenkins-hbase4:35285] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:15,283 DEBUG [jenkins-hbase4:35285] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:15,283 DEBUG [jenkins-hbase4:35285] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:15,285 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44625,1676836814716, state=OPENING 2023-02-19 20:00:15,286 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:15,288 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:15,288 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:15,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44625,1676836814716}] 2023-02-19 20:00:15,443 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:15,444 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:15,447 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53426, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:15,452 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:15,452 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:15,453 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44625%2C1676836814716.meta, suffix=.meta, logDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,44625,1676836814716, archiveDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/oldWALs, maxLogs=32 2023-02-19 20:00:15,470 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK] 2023-02-19 20:00:15,470 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK] 2023-02-19 20:00:15,473 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,44625,1676836814716/jenkins-hbase4.apache.org%2C44625%2C1676836814716.meta.1676836815454.meta 2023-02-19 20:00:15,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK], DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK]] 2023-02-19 20:00:15,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:15,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:15,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:15,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:15,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:15,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:15,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:15,474 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:15,477 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:15,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/info 2023-02-19 20:00:15,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/info 2023-02-19 20:00:15,479 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:15,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:15,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:15,480 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:15,480 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:15,481 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:15,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:15,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:15,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/table 2023-02-19 20:00:15,482 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/table 2023-02-19 20:00:15,482 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:15,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:15,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740 2023-02-19 20:00:15,485 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740 2023-02-19 20:00:15,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:15,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:15,489 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61803680, jitterRate=-0.07905340194702148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:15,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:15,491 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836815443 2023-02-19 20:00:15,495 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:15,496 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:15,496 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44625,1676836814716, state=OPEN 2023-02-19 20:00:15,498 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:15,498 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:15,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:15,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44625,1676836814716 in 210 msec 2023-02-19 20:00:15,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:15,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 386 msec 2023-02-19 20:00:15,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 482 msec 2023-02-19 20:00:15,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836815505, completionTime=-1 2023-02-19 20:00:15,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:15,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:15,510 DEBUG [hconnection-0x38c27fb0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:15,512 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:15,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:15,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836875514 2023-02-19 20:00:15,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836935514 2023-02-19 20:00:15,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-19 20:00:15,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35285,1676836814639-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35285,1676836814639-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35285,1676836814639-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35285, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:15,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:15,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:15,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:15,526 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:15,526 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:15,527 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:15,530 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:15,530 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d empty. 2023-02-19 20:00:15,531 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:15,531 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:15,960 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:15,961 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 604bddcb84a7eb78bface62a9c2e3f3d, NAME => 'hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:15,969 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:15,969 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 604bddcb84a7eb78bface62a9c2e3f3d, disabling compactions & flushes 2023-02-19 20:00:15,969 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:15,969 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:15,969 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. after waiting 0 ms 2023-02-19 20:00:15,969 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:15,969 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:15,970 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 604bddcb84a7eb78bface62a9c2e3f3d: 2023-02-19 20:00:15,972 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:15,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836815973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836815973"}]},"ts":"1676836815973"} 2023-02-19 20:00:15,976 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:15,976 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:15,977 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836815977"}]},"ts":"1676836815977"} 2023-02-19 20:00:15,978 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:15,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:15,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:15,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:15,982 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:15,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=604bddcb84a7eb78bface62a9c2e3f3d, ASSIGN}] 2023-02-19 20:00:15,984 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=604bddcb84a7eb78bface62a9c2e3f3d, ASSIGN 2023-02-19 20:00:15,985 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=604bddcb84a7eb78bface62a9c2e3f3d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39727,1676836814764; forceNewPlan=false, retain=false 2023-02-19 20:00:16,135 INFO [jenkins-hbase4:35285] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:16,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=604bddcb84a7eb78bface62a9c2e3f3d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:16,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836816136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836816136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836816136"}]},"ts":"1676836816136"} 2023-02-19 20:00:16,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 604bddcb84a7eb78bface62a9c2e3f3d, server=jenkins-hbase4.apache.org,39727,1676836814764}] 2023-02-19 20:00:16,222 INFO [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44625%2C1676836814716, suffix=, logDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,44625,1676836814716, archiveDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/oldWALs, maxLogs=32 2023-02-19 20:00:16,239 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK] 2023-02-19 20:00:16,239 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK] 2023-02-19 20:00:16,241 INFO [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,44625,1676836814716/jenkins-hbase4.apache.org%2C44625%2C1676836814716.1676836816223 2023-02-19 20:00:16,244 DEBUG [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK], DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK]] 2023-02-19 20:00:16,250 INFO [RS:1;jenkins-hbase4:39727] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39727%2C1676836814764, suffix=, logDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,39727,1676836814764, archiveDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/oldWALs, maxLogs=32 2023-02-19 20:00:16,270 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK] 2023-02-19 20:00:16,271 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK] 2023-02-19 20:00:16,273 INFO [RS:1;jenkins-hbase4:39727] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/WALs/jenkins-hbase4.apache.org,39727,1676836814764/jenkins-hbase4.apache.org%2C39727%2C1676836814764.1676836816251 2023-02-19 20:00:16,273 DEBUG [RS:1;jenkins-hbase4:39727] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44871,DS-5e869627-c9f6-4c3e-9fb0-d2d60ce3de24,DISK], DatanodeInfoWithStorage[127.0.0.1:46367,DS-31bfae6c-602b-48e7-864d-8ed6f968cbd0,DISK]] 2023-02-19 20:00:16,290 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:16,291 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:16,293 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38368, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:16,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:16,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 604bddcb84a7eb78bface62a9c2e3f3d, NAME => 'hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:16,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,299 INFO [StoreOpener-604bddcb84a7eb78bface62a9c2e3f3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,301 DEBUG [StoreOpener-604bddcb84a7eb78bface62a9c2e3f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/info 2023-02-19 20:00:16,301 DEBUG [StoreOpener-604bddcb84a7eb78bface62a9c2e3f3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/info 2023-02-19 20:00:16,301 INFO [StoreOpener-604bddcb84a7eb78bface62a9c2e3f3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 604bddcb84a7eb78bface62a9c2e3f3d columnFamilyName info 2023-02-19 20:00:16,302 INFO [StoreOpener-604bddcb84a7eb78bface62a9c2e3f3d-1] regionserver.HStore(310): Store=604bddcb84a7eb78bface62a9c2e3f3d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:16,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:16,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:16,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 604bddcb84a7eb78bface62a9c2e3f3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74864875, jitterRate=0.11557357013225555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:16,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 604bddcb84a7eb78bface62a9c2e3f3d: 2023-02-19 20:00:16,310 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d., pid=6, masterSystemTime=1676836816290 2023-02-19 20:00:16,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:16,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:16,314 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=604bddcb84a7eb78bface62a9c2e3f3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:16,314 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836816313"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836816313"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836816313"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836816313"}]},"ts":"1676836816313"} 2023-02-19 20:00:16,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:16,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 604bddcb84a7eb78bface62a9c2e3f3d, server=jenkins-hbase4.apache.org,39727,1676836814764 in 177 msec 2023-02-19 20:00:16,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:16,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=604bddcb84a7eb78bface62a9c2e3f3d, ASSIGN in 336 msec 2023-02-19 20:00:16,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:16,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836816321"}]},"ts":"1676836816321"} 2023-02-19 20:00:16,322 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:16,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:16,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:16,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 802 msec 2023-02-19 20:00:16,327 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:16,327 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:16,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:16,331 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38380, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:16,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:16,342 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:16,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-19 20:00:16,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:16,364 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:16,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-19 20:00:16,379 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:16,382 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:16,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.574sec 2023-02-19 20:00:16,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:16,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:16,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:16,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35285,1676836814639-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:16,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35285,1676836814639-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:16,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:16,409 DEBUG [Listener at localhost/36327] zookeeper.ReadOnlyZKClient(139): Connect 0x6efe6f2a to 127.0.0.1:49975 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:16,414 DEBUG [Listener at localhost/36327] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5516db8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:16,415 DEBUG [hconnection-0x59b8dd25-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:16,418 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53448, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:16,419 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:16,419 DEBUG [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:16,421 DEBUG [Listener at localhost/36327] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:16,423 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:16,423 INFO [Listener at localhost/36327] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 20:00:16,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 20:00:16,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:16,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:53312 deadline: 1676836876424, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 20:00:16,425 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 20:00:16,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:16,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 20:00:16,430 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:16,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 20:00:16,431 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:16,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:16,439 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0 empty. 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8 empty. 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6 empty. 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff empty. 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c empty. 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f empty. 2023-02-19 20:00:16,440 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa empty. 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102 empty. 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:16,441 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8 empty. 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603 empty. 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:16,442 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:16,443 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 20:00:16,456 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:16,458 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a760f4b3ba63ba53103221e7207530f0, NAME => 'testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,458 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 157e11998255e4a6d006d0111450907f, NAME => 'testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,458 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a75a9bd67f43a3b8627d7db0093b781c, NAME => 'testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,480 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,480 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 157e11998255e4a6d006d0111450907f, disabling compactions & flushes 2023-02-19 20:00:16,480 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:16,480 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a760f4b3ba63ba53103221e7207530f0, disabling compactions & flushes 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. after waiting 0 ms 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:16,481 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:16,481 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. after waiting 0 ms 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:16,481 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:16,482 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:16,482 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9d14b50096bf679b49ba9004006e37fa, NAME => 'testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,482 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,482 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a75a9bd67f43a3b8627d7db0093b781c, disabling compactions & flushes 2023-02-19 20:00:16,483 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:16,483 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:16,483 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. after waiting 0 ms 2023-02-19 20:00:16,483 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:16,483 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:16,483 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:16,483 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 660288a1f71c9f92897e3f7a01d61102, NAME => 'testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,481 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:16,485 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c822ba6fa4a0effbce78a988df647fff, NAME => 'testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,493 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,493 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 660288a1f71c9f92897e3f7a01d61102, disabling compactions & flushes 2023-02-19 20:00:16,493 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:16,493 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:16,493 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. after waiting 0 ms 2023-02-19 20:00:16,493 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:16,493 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:16,493 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:16,494 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, NAME => 'testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,502 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,502 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c822ba6fa4a0effbce78a988df647fff, disabling compactions & flushes 2023-02-19 20:00:16,502 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:16,502 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:16,502 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. after waiting 0 ms 2023-02-19 20:00:16,502 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:16,502 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:16,502 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:16,503 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 57787c23882d1df6527b23d74d9abfc6, NAME => 'testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,510 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,510 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, disabling compactions & flushes 2023-02-19 20:00:16,510 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:16,510 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:16,510 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. after waiting 0 ms 2023-02-19 20:00:16,510 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:16,510 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:16,510 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:16,511 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a5489ae59e238c8b9b5657e1a150c603, NAME => 'testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 57787c23882d1df6527b23d74d9abfc6, disabling compactions & flushes 2023-02-19 20:00:16,515 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:16,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:16,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. after waiting 0 ms 2023-02-19 20:00:16,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:16,515 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:16,515 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:16,515 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => eb4e6a1bb5ae931941c1eadc44955ab8, NAME => 'testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.tmp 2023-02-19 20:00:16,518 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,518 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a5489ae59e238c8b9b5657e1a150c603, disabling compactions & flushes 2023-02-19 20:00:16,518 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:16,518 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:16,518 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. after waiting 0 ms 2023-02-19 20:00:16,518 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:16,518 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:16,518 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:16,522 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,522 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing eb4e6a1bb5ae931941c1eadc44955ab8, disabling compactions & flushes 2023-02-19 20:00:16,522 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:16,522 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:16,522 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. after waiting 0 ms 2023-02-19 20:00:16,522 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:16,522 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:16,522 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:16,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:16,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:16,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:16,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9d14b50096bf679b49ba9004006e37fa, disabling compactions & flushes 2023-02-19 20:00:16,898 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:16,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:16,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. after waiting 0 ms 2023-02-19 20:00:16,898 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:16,898 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:16,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:16,901 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,904 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836816902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836816902"}]},"ts":"1676836816902"} 2023-02-19 20:00:16,906 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 20:00:16,907 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:16,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836816908"}]},"ts":"1676836816908"} 2023-02-19 20:00:16,909 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 20:00:16,913 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:16,920 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:16,920 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:16,920 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:16,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a75a9bd67f43a3b8627d7db0093b781c, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=157e11998255e4a6d006d0111450907f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a760f4b3ba63ba53103221e7207530f0, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d14b50096bf679b49ba9004006e37fa, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=660288a1f71c9f92897e3f7a01d61102, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c822ba6fa4a0effbce78a988df647fff, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=68f9f5d0e07ecec8aa0b7f0aaa32ddb8, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=57787c23882d1df6527b23d74d9abfc6, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a5489ae59e238c8b9b5657e1a150c603, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eb4e6a1bb5ae931941c1eadc44955ab8, ASSIGN}] 2023-02-19 20:00:16,923 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=157e11998255e4a6d006d0111450907f, ASSIGN 2023-02-19 20:00:16,923 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a760f4b3ba63ba53103221e7207530f0, ASSIGN 2023-02-19 20:00:16,923 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a75a9bd67f43a3b8627d7db0093b781c, ASSIGN 2023-02-19 20:00:16,923 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d14b50096bf679b49ba9004006e37fa, ASSIGN 2023-02-19 20:00:16,924 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=157e11998255e4a6d006d0111450907f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44625,1676836814716; forceNewPlan=false, retain=false 2023-02-19 20:00:16,924 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a75a9bd67f43a3b8627d7db0093b781c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39727,1676836814764; forceNewPlan=false, retain=false 2023-02-19 20:00:16,924 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a760f4b3ba63ba53103221e7207530f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44625,1676836814716; forceNewPlan=false, retain=false 2023-02-19 20:00:16,924 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9d14b50096bf679b49ba9004006e37fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39727,1676836814764; forceNewPlan=false, retain=false 2023-02-19 20:00:16,924 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eb4e6a1bb5ae931941c1eadc44955ab8, ASSIGN 2023-02-19 20:00:16,925 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a5489ae59e238c8b9b5657e1a150c603, ASSIGN 2023-02-19 20:00:16,925 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=57787c23882d1df6527b23d74d9abfc6, ASSIGN 2023-02-19 20:00:16,925 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=68f9f5d0e07ecec8aa0b7f0aaa32ddb8, ASSIGN 2023-02-19 20:00:16,926 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c822ba6fa4a0effbce78a988df647fff, ASSIGN 2023-02-19 20:00:16,926 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a5489ae59e238c8b9b5657e1a150c603, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39727,1676836814764; forceNewPlan=false, retain=false 2023-02-19 20:00:16,926 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=eb4e6a1bb5ae931941c1eadc44955ab8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44625,1676836814716; forceNewPlan=false, retain=false 2023-02-19 20:00:16,926 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=57787c23882d1df6527b23d74d9abfc6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44625,1676836814716; forceNewPlan=false, retain=false 2023-02-19 20:00:16,926 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=68f9f5d0e07ecec8aa0b7f0aaa32ddb8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39727,1676836814764; forceNewPlan=false, retain=false 2023-02-19 20:00:16,927 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c822ba6fa4a0effbce78a988df647fff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44625,1676836814716; forceNewPlan=false, retain=false 2023-02-19 20:00:16,927 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=660288a1f71c9f92897e3f7a01d61102, ASSIGN 2023-02-19 20:00:16,928 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=660288a1f71c9f92897e3f7a01d61102, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39727,1676836814764; forceNewPlan=false, retain=false 2023-02-19 20:00:17,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:17,074 INFO [jenkins-hbase4:35285] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 20:00:17,078 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c822ba6fa4a0effbce78a988df647fff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,078 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=57787c23882d1df6527b23d74d9abfc6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,078 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a760f4b3ba63ba53103221e7207530f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,078 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817078"}]},"ts":"1676836817078"} 2023-02-19 20:00:17,078 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817078"}]},"ts":"1676836817078"} 2023-02-19 20:00:17,078 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=157e11998255e4a6d006d0111450907f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=eb4e6a1bb5ae931941c1eadc44955ab8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,078 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817077"}]},"ts":"1676836817077"} 2023-02-19 20:00:17,078 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817078"}]},"ts":"1676836817078"} 2023-02-19 20:00:17,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836817078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817078"}]},"ts":"1676836817078"} 2023-02-19 20:00:17,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure c822ba6fa4a0effbce78a988df647fff, server=jenkins-hbase4.apache.org,44625,1676836814716}] 2023-02-19 20:00:17,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure a760f4b3ba63ba53103221e7207530f0, server=jenkins-hbase4.apache.org,44625,1676836814716}] 2023-02-19 20:00:17,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 157e11998255e4a6d006d0111450907f, server=jenkins-hbase4.apache.org,44625,1676836814716}] 2023-02-19 20:00:17,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure 57787c23882d1df6527b23d74d9abfc6, server=jenkins-hbase4.apache.org,44625,1676836814716}] 2023-02-19 20:00:17,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure eb4e6a1bb5ae931941c1eadc44955ab8, server=jenkins-hbase4.apache.org,44625,1676836814716}] 2023-02-19 20:00:17,091 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a5489ae59e238c8b9b5657e1a150c603, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817091"}]},"ts":"1676836817091"} 2023-02-19 20:00:17,093 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=68f9f5d0e07ecec8aa0b7f0aaa32ddb8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817093"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817093"}]},"ts":"1676836817093"} 2023-02-19 20:00:17,093 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9d14b50096bf679b49ba9004006e37fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,093 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817093"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817093"}]},"ts":"1676836817093"} 2023-02-19 20:00:17,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure a5489ae59e238c8b9b5657e1a150c603, server=jenkins-hbase4.apache.org,39727,1676836814764}] 2023-02-19 20:00:17,096 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a75a9bd67f43a3b8627d7db0093b781c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=660288a1f71c9f92897e3f7a01d61102, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,096 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836817096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817096"}]},"ts":"1676836817096"} 2023-02-19 20:00:17,097 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836817096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836817096"}]},"ts":"1676836817096"} 2023-02-19 20:00:17,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, server=jenkins-hbase4.apache.org,39727,1676836814764}] 2023-02-19 20:00:17,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 9d14b50096bf679b49ba9004006e37fa, server=jenkins-hbase4.apache.org,39727,1676836814764}] 2023-02-19 20:00:17,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure a75a9bd67f43a3b8627d7db0093b781c, server=jenkins-hbase4.apache.org,39727,1676836814764}] 2023-02-19 20:00:17,100 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 660288a1f71c9f92897e3f7a01d61102, server=jenkins-hbase4.apache.org,39727,1676836814764}] 2023-02-19 20:00:17,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:17,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a760f4b3ba63ba53103221e7207530f0, NAME => 'testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 20:00:17,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,240 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,241 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1 2023-02-19 20:00:17,241 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1 2023-02-19 20:00:17,241 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a760f4b3ba63ba53103221e7207530f0 columnFamilyName f1 2023-02-19 20:00:17,242 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(310): Store=a760f4b3ba63ba53103221e7207530f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,242 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,243 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2 2023-02-19 20:00:17,243 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2 2023-02-19 20:00:17,244 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a760f4b3ba63ba53103221e7207530f0 columnFamilyName f2 2023-02-19 20:00:17,244 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(310): Store=a760f4b3ba63ba53103221e7207530f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:17,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:17,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, NAME => 'testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 20:00:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a760f4b3ba63ba53103221e7207530f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60226594, jitterRate=-0.10255381464958191}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:17,253 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0., pid=22, masterSystemTime=1676836817233 2023-02-19 20:00:17,254 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1 2023-02-19 20:00:17,254 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1 2023-02-19 20:00:17,255 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 columnFamilyName f1 2023-02-19 20:00:17,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:17,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:17,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:17,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 57787c23882d1df6527b23d74d9abfc6, NAME => 'testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 20:00:17,255 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(310): Store=68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,255 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,255 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a760f4b3ba63ba53103221e7207530f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,256 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817255"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817255"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817255"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817255"}]},"ts":"1676836817255"} 2023-02-19 20:00:17,257 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2 2023-02-19 20:00:17,257 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2 2023-02-19 20:00:17,257 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,257 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 columnFamilyName f2 2023-02-19 20:00:17,258 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(310): Store=68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,259 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1 2023-02-19 20:00:17,259 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1 2023-02-19 20:00:17,259 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57787c23882d1df6527b23d74d9abfc6 columnFamilyName f1 2023-02-19 20:00:17,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-19 20:00:17,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure a760f4b3ba63ba53103221e7207530f0, server=jenkins-hbase4.apache.org,44625,1676836814716 in 177 msec 2023-02-19 20:00:17,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a760f4b3ba63ba53103221e7207530f0, ASSIGN in 339 msec 2023-02-19 20:00:17,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,265 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(310): Store=57787c23882d1df6527b23d74d9abfc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,265 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,267 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2 2023-02-19 20:00:17,267 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2 2023-02-19 20:00:17,267 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57787c23882d1df6527b23d74d9abfc6 columnFamilyName f2 2023-02-19 20:00:17,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,267 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(310): Store=57787c23882d1df6527b23d74d9abfc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:17,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 68f9f5d0e07ecec8aa0b7f0aaa32ddb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62061820, jitterRate=-0.07520681619644165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:17,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8., pid=27, masterSystemTime=1676836817248 2023-02-19 20:00:17,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:17,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:17,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:17,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 660288a1f71c9f92897e3f7a01d61102, NAME => 'testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 20:00:17,276 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=68f9f5d0e07ecec8aa0b7f0aaa32ddb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,276 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817276"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817276"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817276"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817276"}]},"ts":"1676836817276"} 2023-02-19 20:00:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 57787c23882d1df6527b23d74d9abfc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68445633, jitterRate=0.019919410347938538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:17,278 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6., pid=24, masterSystemTime=1676836817233 2023-02-19 20:00:17,279 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1 2023-02-19 20:00:17,279 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1 2023-02-19 20:00:17,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:17,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:17,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:17,280 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 660288a1f71c9f92897e3f7a01d61102 columnFamilyName f1 2023-02-19 20:00:17,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-19 20:00:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eb4e6a1bb5ae931941c1eadc44955ab8, NAME => 'testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 20:00:17,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, server=jenkins-hbase4.apache.org,39727,1676836814764 in 181 msec 2023-02-19 20:00:17,280 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=57787c23882d1df6527b23d74d9abfc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,280 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817280"}]},"ts":"1676836817280"} 2023-02-19 20:00:17,280 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(310): Store=660288a1f71c9f92897e3f7a01d61102/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,280 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,282 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,282 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2 2023-02-19 20:00:17,282 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2 2023-02-19 20:00:17,283 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 660288a1f71c9f92897e3f7a01d61102 columnFamilyName f2 2023-02-19 20:00:17,284 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(310): Store=660288a1f71c9f92897e3f7a01d61102/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,284 DEBUG [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/f1 2023-02-19 20:00:17,284 DEBUG [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/f1 2023-02-19 20:00:17,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=68f9f5d0e07ecec8aa0b7f0aaa32ddb8, ASSIGN in 359 msec 2023-02-19 20:00:17,284 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb4e6a1bb5ae931941c1eadc44955ab8 columnFamilyName f1 2023-02-19 20:00:17,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-19 20:00:17,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure 57787c23882d1df6527b23d74d9abfc6, server=jenkins-hbase4.apache.org,44625,1676836814716 in 194 msec 2023-02-19 20:00:17,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,285 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(310): Store=eb4e6a1bb5ae931941c1eadc44955ab8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,285 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=57787c23882d1df6527b23d74d9abfc6, ASSIGN in 364 msec 2023-02-19 20:00:17,287 DEBUG [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/f2 2023-02-19 20:00:17,287 DEBUG [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/f2 2023-02-19 20:00:17,287 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb4e6a1bb5ae931941c1eadc44955ab8 columnFamilyName f2 2023-02-19 20:00:17,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,287 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(310): Store=eb4e6a1bb5ae931941c1eadc44955ab8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:17,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 660288a1f71c9f92897e3f7a01d61102; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74062117, jitterRate=0.1036115437746048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:17,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102., pid=30, masterSystemTime=1676836817248 2023-02-19 20:00:17,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:17,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:17,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:17,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:17,293 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=660288a1f71c9f92897e3f7a01d61102, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a75a9bd67f43a3b8627d7db0093b781c, NAME => 'testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 20:00:17,294 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817293"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817293"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817293"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817293"}]},"ts":"1676836817293"} 2023-02-19 20:00:17,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,295 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened eb4e6a1bb5ae931941c1eadc44955ab8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70035175, jitterRate=0.04360543191432953}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:17,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8., pid=25, masterSystemTime=1676836817233 2023-02-19 20:00:17,297 DEBUG [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/f1 2023-02-19 20:00:17,297 DEBUG [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/f1 2023-02-19 20:00:17,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-19 20:00:17,298 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a75a9bd67f43a3b8627d7db0093b781c columnFamilyName f1 2023-02-19 20:00:17,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 660288a1f71c9f92897e3f7a01d61102, server=jenkins-hbase4.apache.org,39727,1676836814764 in 195 msec 2023-02-19 20:00:17,298 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(310): Store=a75a9bd67f43a3b8627d7db0093b781c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,299 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:17,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:17,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:17,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c822ba6fa4a0effbce78a988df647fff, NAME => 'testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 20:00:17,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,300 DEBUG [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/f2 2023-02-19 20:00:17,300 DEBUG [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/f2 2023-02-19 20:00:17,300 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=eb4e6a1bb5ae931941c1eadc44955ab8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,300 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836817300"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817300"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817300"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817300"}]},"ts":"1676836817300"} 2023-02-19 20:00:17,301 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a75a9bd67f43a3b8627d7db0093b781c columnFamilyName f2 2023-02-19 20:00:17,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=660288a1f71c9f92897e3f7a01d61102, ASSIGN in 377 msec 2023-02-19 20:00:17,301 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(310): Store=a75a9bd67f43a3b8627d7db0093b781c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,304 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-19 20:00:17,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure eb4e6a1bb5ae931941c1eadc44955ab8, server=jenkins-hbase4.apache.org,44625,1676836814716 in 214 msec 2023-02-19 20:00:17,305 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1 2023-02-19 20:00:17,306 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1 2023-02-19 20:00:17,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eb4e6a1bb5ae931941c1eadc44955ab8, ASSIGN in 383 msec 2023-02-19 20:00:17,306 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c822ba6fa4a0effbce78a988df647fff columnFamilyName f1 2023-02-19 20:00:17,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,307 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(310): Store=c822ba6fa4a0effbce78a988df647fff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,307 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,308 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2 2023-02-19 20:00:17,308 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2 2023-02-19 20:00:17,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:17,308 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c822ba6fa4a0effbce78a988df647fff columnFamilyName f2 2023-02-19 20:00:17,309 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(310): Store=c822ba6fa4a0effbce78a988df647fff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:17,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a75a9bd67f43a3b8627d7db0093b781c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74875291, jitterRate=0.11572878062725067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c822ba6fa4a0effbce78a988df647fff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59946291, jitterRate=-0.10673065483570099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:17,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:17,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c., pid=29, masterSystemTime=1676836817248 2023-02-19 20:00:17,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff., pid=21, masterSystemTime=1676836817233 2023-02-19 20:00:17,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:17,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:17,328 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a75a9bd67f43a3b8627d7db0093b781c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:17,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676836817328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817328"}]},"ts":"1676836817328"} 2023-02-19 20:00:17,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9d14b50096bf679b49ba9004006e37fa, NAME => 'testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 20:00:17,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:17,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:17,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 157e11998255e4a6d006d0111450907f, NAME => 'testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,331 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,331 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c822ba6fa4a0effbce78a988df647fff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,332 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817332"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817332"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817332"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817332"}]},"ts":"1676836817332"} 2023-02-19 20:00:17,332 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1 2023-02-19 20:00:17,333 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1 2023-02-19 20:00:17,333 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 157e11998255e4a6d006d0111450907f columnFamilyName f1 2023-02-19 20:00:17,333 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1 2023-02-19 20:00:17,334 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1 2023-02-19 20:00:17,334 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(310): Store=157e11998255e4a6d006d0111450907f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,334 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d14b50096bf679b49ba9004006e37fa columnFamilyName f1 2023-02-19 20:00:17,335 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-19 20:00:17,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure a75a9bd67f43a3b8627d7db0093b781c, server=jenkins-hbase4.apache.org,39727,1676836814764 in 234 msec 2023-02-19 20:00:17,335 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(310): Store=9d14b50096bf679b49ba9004006e37fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,336 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,337 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2 2023-02-19 20:00:17,337 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2 2023-02-19 20:00:17,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a75a9bd67f43a3b8627d7db0093b781c, ASSIGN in 414 msec 2023-02-19 20:00:17,337 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 157e11998255e4a6d006d0111450907f columnFamilyName f2 2023-02-19 20:00:17,338 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2 2023-02-19 20:00:17,338 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2 2023-02-19 20:00:17,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-19 20:00:17,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure c822ba6fa4a0effbce78a988df647fff, server=jenkins-hbase4.apache.org,44625,1676836814716 in 255 msec 2023-02-19 20:00:17,338 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(310): Store=157e11998255e4a6d006d0111450907f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,338 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d14b50096bf679b49ba9004006e37fa columnFamilyName f2 2023-02-19 20:00:17,339 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(310): Store=9d14b50096bf679b49ba9004006e37fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c822ba6fa4a0effbce78a988df647fff, ASSIGN in 417 msec 2023-02-19 20:00:17,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:17,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:17,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 157e11998255e4a6d006d0111450907f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67362933, jitterRate=0.00378592312335968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:17,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f., pid=23, masterSystemTime=1676836817233 2023-02-19 20:00:17,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9d14b50096bf679b49ba9004006e37fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73156805, jitterRate=0.09012134373188019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:17,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:17,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:17,350 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=157e11998255e4a6d006d0111450907f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,350 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817350"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817350"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817350"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817350"}]},"ts":"1676836817350"} 2023-02-19 20:00:17,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa., pid=28, masterSystemTime=1676836817248 2023-02-19 20:00:17,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:17,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:17,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:17,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a5489ae59e238c8b9b5657e1a150c603, NAME => 'testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 20:00:17,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9d14b50096bf679b49ba9004006e37fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817352"}]},"ts":"1676836817352"} 2023-02-19 20:00:17,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:17,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-19 20:00:17,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 157e11998255e4a6d006d0111450907f, server=jenkins-hbase4.apache.org,44625,1676836814716 in 270 msec 2023-02-19 20:00:17,354 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=157e11998255e4a6d006d0111450907f, ASSIGN in 433 msec 2023-02-19 20:00:17,356 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1 2023-02-19 20:00:17,356 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1 2023-02-19 20:00:17,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-19 20:00:17,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 9d14b50096bf679b49ba9004006e37fa, server=jenkins-hbase4.apache.org,39727,1676836814764 in 256 msec 2023-02-19 20:00:17,356 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5489ae59e238c8b9b5657e1a150c603 columnFamilyName f1 2023-02-19 20:00:17,357 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(310): Store=a5489ae59e238c8b9b5657e1a150c603/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,357 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d14b50096bf679b49ba9004006e37fa, ASSIGN in 435 msec 2023-02-19 20:00:17,358 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2 2023-02-19 20:00:17,358 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2 2023-02-19 20:00:17,358 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5489ae59e238c8b9b5657e1a150c603 columnFamilyName f2 2023-02-19 20:00:17,359 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(310): Store=a5489ae59e238c8b9b5657e1a150c603/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:17,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:17,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:17,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:17,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a5489ae59e238c8b9b5657e1a150c603; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68739170, jitterRate=0.024293452501296997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:17,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:17,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603., pid=26, masterSystemTime=1676836817248 2023-02-19 20:00:17,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:17,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:17,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a5489ae59e238c8b9b5657e1a150c603, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,367 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676836817367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836817367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836817367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836817367"}]},"ts":"1676836817367"} 2023-02-19 20:00:17,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-19 20:00:17,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure a5489ae59e238c8b9b5657e1a150c603, server=jenkins-hbase4.apache.org,39727,1676836814764 in 275 msec 2023-02-19 20:00:17,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-19 20:00:17,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a5489ae59e238c8b9b5657e1a150c603, ASSIGN in 449 msec 2023-02-19 20:00:17,372 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:17,373 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836817373"}]},"ts":"1676836817373"} 2023-02-19 20:00:17,374 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 20:00:17,376 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:17,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 949 msec 2023-02-19 20:00:17,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:17,539 INFO [Listener at localhost/36327] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 20:00:17,539 DEBUG [Listener at localhost/36327] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 20:00:17,539 INFO [Listener at localhost/36327] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:17,543 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 20:00:17,543 INFO [Listener at localhost/36327] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:17,544 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 20:00:17,544 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:17,562 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:17,634 DEBUG [hconnection-0x59b8dd25-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:17,656 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:17,659 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44625] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:17,667 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39727] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:17,828 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:17,828 INFO [Listener at localhost/36327] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:17,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:17,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836817830 (current time:1676836817830). 2023-02-19 20:00:17,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:17,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] zookeeper.ReadOnlyZKClient(139): Connect 0x20e3976f to 127.0.0.1:49975 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@817f3c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:17,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:17,842 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53454, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20e3976f to 127.0.0.1:49975 2023-02-19 20:00:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:17,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:17,847 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:17,848 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676837417848 2023-02-19 20:00:17,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:17,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 20:00:17,849 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:17,849 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:17,850 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:17,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:17,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-19 20:00:17,852 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:17,853 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676837417853 2023-02-19 20:00:17,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,875 INFO [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-19 20:00:17,875 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:17,884 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-19 20:00:17,884 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-19 20:00:17,884 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,884 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,888 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:17,888 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:17,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:17,888 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:17,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:17,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:17,889 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,889 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,889 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,889 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:17,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-19 20:00:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-19 20:00:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,890 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 20:00:17,890 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 20:00:17,891 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,891 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-19 20:00:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:17,891 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-19 20:00:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-19 20:00:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-19 20:00:17,893 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-19 20:00:17,892 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-19 20:00:17,893 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39727,1676836814764' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-19 20:00:17,893 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44625,1676836814716' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-19 20:00:17,894 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,894 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:17,895 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:17,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39727,1676836814764' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-19 20:00:17,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6046ee76[Count = 1] remaining members to acquire global barrier 2023-02-19 20:00:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:17,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44625,1676836814716' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-19 20:00:17,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6046ee76[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:17,900 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-19 20:00:17,900 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:17,901 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:17,901 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:17,902 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:17,902 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:17,902 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. started... 2023-02-19 20:00:17,902 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:17,903 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:17,903 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:17,903 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,903 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:17,903 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. started... 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:00:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. started... 2023-02-19 20:00:17,903 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:17,903 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. started... 2023-02-19 20:00:17,905 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:17,905 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. started... 2023-02-19 20:00:17,905 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a5489ae59e238c8b9b5657e1a150c603 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:00:17,905 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:17,904 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. started... 2023-02-19 20:00:17,907 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a760f4b3ba63ba53103221e7207530f0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:17,907 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:17,906 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c822ba6fa4a0effbce78a988df647fff 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:17,907 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:17,908 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 660288a1f71c9f92897e3f7a01d61102 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:17,908 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:17,908 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:17,938 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. completed. 2023-02-19 20:00:17,938 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:17,938 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:00:17,938 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:17,938 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. started... 2023-02-19 20:00:17,940 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:17,956 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:17,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:17,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:17,959 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:17,961 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. completed. 2023-02-19 20:00:17,961 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:17,962 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:00:17,962 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. started... 2023-02-19 20:00:17,962 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 57787c23882d1df6527b23d74d9abfc6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:17,977 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f1/356028d1410c4a27ab004f07be6f5586 2023-02-19 20:00:17,996 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f1/3ce83ef88bfa477bba8e8e47f5bae09b 2023-02-19 20:00:18,008 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f1/dabd7bdbad7a4622a63bfe95cfabbea2 2023-02-19 20:00:18,018 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f1/4332c8a50b3f4dfc8b16d5720392d5f7 2023-02-19 20:00:18,040 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f2/58a38e8c203b44aab72d29231fd8d5ff 2023-02-19 20:00:18,047 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f1/356028d1410c4a27ab004f07be6f5586 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/356028d1410c4a27ab004f07be6f5586 2023-02-19 20:00:18,054 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/356028d1410c4a27ab004f07be6f5586, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,055 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f2/58a38e8c203b44aab72d29231fd8d5ff as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/58a38e8c203b44aab72d29231fd8d5ff 2023-02-19 20:00:18,064 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f2/7f9e2494a9114fb793dfc158f6aed936 2023-02-19 20:00:18,066 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/58a38e8c203b44aab72d29231fd8d5ff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,067 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a760f4b3ba63ba53103221e7207530f0 in 160ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,067 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 20:00:18,068 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:18,068 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,069 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,069 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/356028d1410c4a27ab004f07be6f5586] hfiles 2023-02-19 20:00:18,069 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/356028d1410c4a27ab004f07be6f5586 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,069 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/58a38e8c203b44aab72d29231fd8d5ff] hfiles 2023-02-19 20:00:18,069 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/58a38e8c203b44aab72d29231fd8d5ff for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,072 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f2/8682d504fd334fb592c39f166aeb19ad 2023-02-19 20:00:18,077 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f2/0fc7d0f30bd5448982c0cc05c598b357 2023-02-19 20:00:18,078 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f1/dabd7bdbad7a4622a63bfe95cfabbea2 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/dabd7bdbad7a4622a63bfe95cfabbea2 2023-02-19 20:00:18,082 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f1/3ce83ef88bfa477bba8e8e47f5bae09b as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/3ce83ef88bfa477bba8e8e47f5bae09b 2023-02-19 20:00:18,085 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/dabd7bdbad7a4622a63bfe95cfabbea2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,086 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f1/4332c8a50b3f4dfc8b16d5720392d5f7 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/4332c8a50b3f4dfc8b16d5720392d5f7 2023-02-19 20:00:18,086 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f2/7f9e2494a9114fb793dfc158f6aed936 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/7f9e2494a9114fb793dfc158f6aed936 2023-02-19 20:00:18,089 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/3ce83ef88bfa477bba8e8e47f5bae09b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,092 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f2/8682d504fd334fb592c39f166aeb19ad as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/8682d504fd334fb592c39f166aeb19ad 2023-02-19 20:00:18,103 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/7f9e2494a9114fb793dfc158f6aed936, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,104 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 57787c23882d1df6527b23d74d9abfc6 in 142ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,104 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/4332c8a50b3f4dfc8b16d5720392d5f7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,105 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f2/0fc7d0f30bd5448982c0cc05c598b357 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/0fc7d0f30bd5448982c0cc05c598b357 2023-02-19 20:00:18,107 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/8682d504fd334fb592c39f166aeb19ad, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,108 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 660288a1f71c9f92897e3f7a01d61102 in 201ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,114 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/dabd7bdbad7a4622a63bfe95cfabbea2] hfiles 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/3ce83ef88bfa477bba8e8e47f5bae09b] hfiles 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/dabd7bdbad7a4622a63bfe95cfabbea2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/7f9e2494a9114fb793dfc158f6aed936] hfiles 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/7f9e2494a9114fb793dfc158f6aed936 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/3ce83ef88bfa477bba8e8e47f5bae09b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/8682d504fd334fb592c39f166aeb19ad] hfiles 2023-02-19 20:00:18,115 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/8682d504fd334fb592c39f166aeb19ad for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,121 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/0fc7d0f30bd5448982c0cc05c598b357, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,121 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 in 181ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/4332c8a50b3f4dfc8b16d5720392d5f7] hfiles 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/4332c8a50b3f4dfc8b16d5720392d5f7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/0fc7d0f30bd5448982c0cc05c598b357] hfiles 2023-02-19 20:00:18,122 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/0fc7d0f30bd5448982c0cc05c598b357 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,141 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. completed. 2023-02-19 20:00:18,141 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:18,142 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:18,142 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:00:18,142 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. started... 2023-02-19 20:00:18,142 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 157e11998255e4a6d006d0111450907f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:00:18,152 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. completed. 2023-02-19 20:00:18,152 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:18,152 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:18,152 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. started... 2023-02-19 20:00:18,152 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:00:18,152 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9d14b50096bf679b49ba9004006e37fa 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:18,152 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. completed. 2023-02-19 20:00:18,153 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:18,153 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:00:18,159 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:18,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:18,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:18,162 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 20:00:18,167 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. completed. 2023-02-19 20:00:18,168 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:18,168 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:00:18,179 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f1/f40e1441be2a421297284c783f1e3f40 2023-02-19 20:00:18,199 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f2/f3c12059feb3433384f59b2658a68f28 2023-02-19 20:00:18,204 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f1/f40e1441be2a421297284c783f1e3f40 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/f40e1441be2a421297284c783f1e3f40 2023-02-19 20:00:18,210 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/f40e1441be2a421297284c783f1e3f40, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,216 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f2/f3c12059feb3433384f59b2658a68f28 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/f3c12059feb3433384f59b2658a68f28 2023-02-19 20:00:18,223 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/f3c12059feb3433384f59b2658a68f28, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,224 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9d14b50096bf679b49ba9004006e37fa in 72ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,224 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:18,224 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,224 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,224 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/f40e1441be2a421297284c783f1e3f40] hfiles 2023-02-19 20:00:18,224 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/f40e1441be2a421297284c783f1e3f40 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,224 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/f3c12059feb3433384f59b2658a68f28] hfiles 2023-02-19 20:00:18,225 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/f3c12059feb3433384f59b2658a68f28 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,237 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. completed. 2023-02-19 20:00:18,237 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:18,237 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:00:18,380 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f1/526bd1e9dd2b4bef916312de69a2092a 2023-02-19 20:00:18,380 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f1/9eb99d3133c84f5cb5cd30e8c62d7e76 2023-02-19 20:00:18,403 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f2/a1d3e6cbb9024b0798b0427c57615116 2023-02-19 20:00:18,403 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f2/3f818a8ad1884238a4ce6c8da8d7ee02 2023-02-19 20:00:18,409 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f1/9eb99d3133c84f5cb5cd30e8c62d7e76 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/9eb99d3133c84f5cb5cd30e8c62d7e76 2023-02-19 20:00:18,413 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/9eb99d3133c84f5cb5cd30e8c62d7e76, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:18,414 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f2/a1d3e6cbb9024b0798b0427c57615116 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/a1d3e6cbb9024b0798b0427c57615116 2023-02-19 20:00:18,420 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/a1d3e6cbb9024b0798b0427c57615116, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:18,421 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for a5489ae59e238c8b9b5657e1a150c603 in 515ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/9eb99d3133c84f5cb5cd30e8c62d7e76] hfiles 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/9eb99d3133c84f5cb5cd30e8c62d7e76 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/a1d3e6cbb9024b0798b0427c57615116] hfiles 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/a1d3e6cbb9024b0798b0427c57615116 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,421 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f1/526bd1e9dd2b4bef916312de69a2092a as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/526bd1e9dd2b4bef916312de69a2092a 2023-02-19 20:00:18,430 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/526bd1e9dd2b4bef916312de69a2092a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,431 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f2/3f818a8ad1884238a4ce6c8da8d7ee02 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/3f818a8ad1884238a4ce6c8da8d7ee02 2023-02-19 20:00:18,437 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/3f818a8ad1884238a4ce6c8da8d7ee02, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:18,438 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c822ba6fa4a0effbce78a988df647fff in 532ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,438 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:18,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/526bd1e9dd2b4bef916312de69a2092a] hfiles 2023-02-19 20:00:18,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/526bd1e9dd2b4bef916312de69a2092a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/3f818a8ad1884238a4ce6c8da8d7ee02] hfiles 2023-02-19 20:00:18,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/3f818a8ad1884238a4ce6c8da8d7ee02 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,456 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. completed. 2023-02-19 20:00:18,456 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:18,456 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:00:18,462 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:18,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:18,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:18,464 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 20:00:18,581 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f1/845161bf813e4c86b07ee43b664b43da 2023-02-19 20:00:18,596 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f2/b555679aafdc4b3bae0490e5d362558d 2023-02-19 20:00:18,601 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f1/845161bf813e4c86b07ee43b664b43da as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/845161bf813e4c86b07ee43b664b43da 2023-02-19 20:00:18,605 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/845161bf813e4c86b07ee43b664b43da, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:18,606 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f2/b555679aafdc4b3bae0490e5d362558d as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/b555679aafdc4b3bae0490e5d362558d 2023-02-19 20:00:18,611 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/b555679aafdc4b3bae0490e5d362558d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:18,611 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 157e11998255e4a6d006d0111450907f in 469ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/845161bf813e4c86b07ee43b664b43da] hfiles 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/845161bf813e4c86b07ee43b664b43da for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/b555679aafdc4b3bae0490e5d362558d] hfiles 2023-02-19 20:00:18,612 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/b555679aafdc4b3bae0490e5d362558d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,618 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. completed. 2023-02-19 20:00:18,618 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:00:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:00:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-19 20:00:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,44625,1676836814716' in zk 2023-02-19 20:00:18,621 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-19 20:00:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:18,622 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-19 20:00:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,44625,1676836814716': 2023-02-19 20:00:18,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44625,1676836814716' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 20:00:18,835 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. completed. 2023-02-19 20:00:18,835 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:18,835 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:00:18,836 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:00:18,836 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,836 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-19 20:00:18,836 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,39727,1676836814764' in zk 2023-02-19 20:00:18,837 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,837 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-19 20:00:18,837 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:18,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:18,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:18,837 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-19 20:00:18,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:18,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:18,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:18,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,39727,1676836814764': 2023-02-19 20:00:18,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39727,1676836814764' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:18,843 INFO [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-19 20:00:18,843 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:18,843 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:18,843 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,843 INFO [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:18,845 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:18,845 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:18,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:18,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:18,846 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,847 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:18,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:18,849 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,849 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,859 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,859 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:18,859 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:18,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:18,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:18,859 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:18,859 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:18,859 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,859 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:18,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:18,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,860 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,861 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,861 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:18,861 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,861 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:18,861 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,861 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:18,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:18,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:18,964 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:18,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:18,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:18,966 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-19 20:00:19,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:19,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-19 20:00:19,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:19,342 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:19,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676836817848Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676836818860 (+1012 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676836818861 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676836818873 (+12 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676836819286 (+413 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676836819341 (+55 ms) 2023-02-19 20:00:19,343 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:19,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.4940 sec 2023-02-19 20:00:19,966 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:19,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:19,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:19,969 INFO [Listener at localhost/36327] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:19,974 INFO [Listener at localhost/36327] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:19,983 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:20,021 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39727] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:20,022 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44625] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:20,385 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:20,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:20,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 20:00:20,424 INFO [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 20:00:20,425 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:20,425 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 20:00:20,425 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 20:00:20,426 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:20,426 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:20,428 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:20,428 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:20,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:20,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:20,428 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:20,428 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:20,428 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:20,429 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:20,429 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:20,429 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 20:00:20,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 20:00:20,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 20:00:20,434 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 20:00:20,434 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:20,434 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 20:00:20,435 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 20:00:20,435 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:20,436 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 20:00:20,436 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:20,436 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. started... 2023-02-19 20:00:20,436 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. started... 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:20,437 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a5489ae59e238c8b9b5657e1a150c603 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. started... 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:20,437 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 20:00:20,437 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:20,437 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. started... 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:20,437 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. started... 2023-02-19 20:00:20,437 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:20,437 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 660288a1f71c9f92897e3f7a01d61102 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:20,438 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:20,438 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. started... 2023-02-19 20:00:20,438 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c822ba6fa4a0effbce78a988df647fff 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:20,439 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 20:00:20,440 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:20,439 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:20,440 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. started... 2023-02-19 20:00:20,440 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:20,441 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 20:00:20,440 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. started... 2023-02-19 20:00:20,441 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 57787c23882d1df6527b23d74d9abfc6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:20,441 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a760f4b3ba63ba53103221e7207530f0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:20,476 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f1/5443f3a4fcfe4b57adf5295e12648943 2023-02-19 20:00:20,496 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f1/c7cb1e80f3c24f02a889be1d48a908dd 2023-02-19 20:00:20,496 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f1/104654c14f61496b8bc610afbf38958a 2023-02-19 20:00:20,497 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f1/5db9610220a146f38f5cec2811e85326 2023-02-19 20:00:20,498 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f1/d80e7407c68c4ad68a504427a235d5ce 2023-02-19 20:00:20,505 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f1/fd0b87f317b347ada7fb25614e2ca392 2023-02-19 20:00:20,554 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f2/5bccb6341168497996d7afa58da2bdd8 2023-02-19 20:00:20,561 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f1/5443f3a4fcfe4b57adf5295e12648943 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/5443f3a4fcfe4b57adf5295e12648943 2023-02-19 20:00:20,570 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/5443f3a4fcfe4b57adf5295e12648943, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,571 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f2/c1c08e3333854296a678e51fb2dd09c0 2023-02-19 20:00:20,571 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/.tmp/f2/5bccb6341168497996d7afa58da2bdd8 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/5bccb6341168497996d7afa58da2bdd8 2023-02-19 20:00:20,577 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f2/42bd79a1433e47b1ba6fe92df90e178a 2023-02-19 20:00:20,581 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f2/7e24f9eab19d41f6838f5a3e2c02682d 2023-02-19 20:00:20,582 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f1/5db9610220a146f38f5cec2811e85326 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/5db9610220a146f38f5cec2811e85326 2023-02-19 20:00:20,582 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/5bccb6341168497996d7afa58da2bdd8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,582 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f2/6aef61e7da024163ac588e442c762646 2023-02-19 20:00:20,583 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 in 146ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,584 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:20,584 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:20,589 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/5db9610220a146f38f5cec2811e85326, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,591 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/.tmp/f2/c1c08e3333854296a678e51fb2dd09c0 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/c1c08e3333854296a678e51fb2dd09c0 2023-02-19 20:00:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f1/fd0b87f317b347ada7fb25614e2ca392 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/fd0b87f317b347ada7fb25614e2ca392 2023-02-19 20:00:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f1/c7cb1e80f3c24f02a889be1d48a908dd as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/c7cb1e80f3c24f02a889be1d48a908dd 2023-02-19 20:00:20,596 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 20:00:20,596 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. started... 2023-02-19 20:00:20,596 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9d14b50096bf679b49ba9004006e37fa 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:20,602 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/c1c08e3333854296a678e51fb2dd09c0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,603 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a760f4b3ba63ba53103221e7207530f0 in 162ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,603 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:20,603 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:20,603 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f1/104654c14f61496b8bc610afbf38958a as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/104654c14f61496b8bc610afbf38958a 2023-02-19 20:00:20,605 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/c7cb1e80f3c24f02a889be1d48a908dd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,605 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/fd0b87f317b347ada7fb25614e2ca392, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,606 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/.tmp/f2/42bd79a1433e47b1ba6fe92df90e178a as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/42bd79a1433e47b1ba6fe92df90e178a 2023-02-19 20:00:20,606 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/.tmp/f2/7e24f9eab19d41f6838f5a3e2c02682d as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/7e24f9eab19d41f6838f5a3e2c02682d 2023-02-19 20:00:20,608 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 20:00:20,608 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. started... 2023-02-19 20:00:20,608 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 157e11998255e4a6d006d0111450907f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 20:00:20,609 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/104654c14f61496b8bc610afbf38958a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,611 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/.tmp/f2/6aef61e7da024163ac588e442c762646 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/6aef61e7da024163ac588e442c762646 2023-02-19 20:00:20,617 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/6aef61e7da024163ac588e442c762646, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,618 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 660288a1f71c9f92897e3f7a01d61102 in 181ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,618 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:20,618 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 20:00:20,622 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/7e24f9eab19d41f6838f5a3e2c02682d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,623 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c822ba6fa4a0effbce78a988df647fff in 185ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,623 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:20,623 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:20,623 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 20:00:20,624 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/42bd79a1433e47b1ba6fe92df90e178a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,625 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 57787c23882d1df6527b23d74d9abfc6 in 184ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,625 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:20,625 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:20,625 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 20:00:20,632 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f1/669750b70d8743b89efcfef56f96bee0 2023-02-19 20:00:20,636 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f1/509729a9fa604afe8c1326dc8e10e183 2023-02-19 20:00:20,684 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f2/c6a79c6bad374b01851d6a6f6477279f 2023-02-19 20:00:20,695 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f2/bbee7505d32f454c8f7a0bdb598bd8ba 2023-02-19 20:00:20,695 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f1/669750b70d8743b89efcfef56f96bee0 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/669750b70d8743b89efcfef56f96bee0 2023-02-19 20:00:20,702 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f1/509729a9fa604afe8c1326dc8e10e183 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/509729a9fa604afe8c1326dc8e10e183 2023-02-19 20:00:20,702 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/669750b70d8743b89efcfef56f96bee0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,703 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/.tmp/f2/c6a79c6bad374b01851d6a6f6477279f as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/c6a79c6bad374b01851d6a6f6477279f 2023-02-19 20:00:20,709 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/509729a9fa604afe8c1326dc8e10e183, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:20,710 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/.tmp/f2/bbee7505d32f454c8f7a0bdb598bd8ba as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/bbee7505d32f454c8f7a0bdb598bd8ba 2023-02-19 20:00:20,710 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/c6a79c6bad374b01851d6a6f6477279f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:20,711 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9d14b50096bf679b49ba9004006e37fa in 115ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,711 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:20,711 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:20,711 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 20:00:20,717 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/bbee7505d32f454c8f7a0bdb598bd8ba, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:20,718 INFO [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 157e11998255e4a6d006d0111450907f in 110ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:20,719 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:20,719 DEBUG [rs(jenkins-hbase4.apache.org,44625,1676836814716)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:20,719 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 20:00:20,719 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 20:00:20,719 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:20,719 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 20:00:20,719 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44625,1676836814716' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 20:00:20,721 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:20,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44625,1676836814716' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 20:00:20,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@647976a6[Count = 1] remaining members to acquire global barrier 2023-02-19 20:00:20,983 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f2/4ed12767f3204b78ab82782e660f75f6 2023-02-19 20:00:20,989 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f1/d80e7407c68c4ad68a504427a235d5ce as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/d80e7407c68c4ad68a504427a235d5ce 2023-02-19 20:00:20,994 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/d80e7407c68c4ad68a504427a235d5ce, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:20,995 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/.tmp/f2/4ed12767f3204b78ab82782e660f75f6 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/4ed12767f3204b78ab82782e660f75f6 2023-02-19 20:00:21,001 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/4ed12767f3204b78ab82782e660f75f6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:21,002 INFO [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for a5489ae59e238c8b9b5657e1a150c603 in 565ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:21,002 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:21,002 DEBUG [rs(jenkins-hbase4.apache.org,39727,1676836814764)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:21,002 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 20:00:21,002 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 20:00:21,002 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,003 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 20:00:21,003 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39727,1676836814764' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 20:00:21,006 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,006 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:21,006 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,006 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:21,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39727,1676836814764' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 20:00:21,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@647976a6[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:21,008 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 20:00:21,008 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,010 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,010 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 20:00:21,010 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 20:00:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44625,1676836814716' in zk 2023-02-19 20:00:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,011 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 20:00:21,011 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 20:00:21,011 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,39727,1676836814764' in zk 2023-02-19 20:00:21,011 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,011 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:21,012 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,012 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 20:00:21,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:21,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:21,013 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:21,013 DEBUG [member: 'jenkins-hbase4.apache.org,44625,1676836814716' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 20:00:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 20:00:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:21,014 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,39727,1676836814764' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 20:00:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44625,1676836814716': 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44625,1676836814716' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,39727,1676836814764': 2023-02-19 20:00:21,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39727,1676836814764' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 20:00:21,021 INFO [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 20:00:21,021 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:21,021 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:21,021 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 20:00:21,021 INFO [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:21,024 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:21,024 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:21,024 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:21,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:21,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,028 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:21,028 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,030 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:21,030 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,033 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,033 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:21,033 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:21,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:21,033 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 20:00:21,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:21,033 DEBUG [(jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:21,033 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:21,033 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:21,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:21,034 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:21,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:21,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:21,034 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:21,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:21,035 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:21,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:21,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:21,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:21,135 DEBUG [Listener at localhost/36327] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:21,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35285] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:21,137 INFO [Listener at localhost/36327] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:21,138 DEBUG [Listener at localhost/36327] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6efe6f2a to 127.0.0.1:49975 2023-02-19 20:00:21,138 DEBUG [Listener at localhost/36327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,138 DEBUG [Listener at localhost/36327] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:21,138 DEBUG [Listener at localhost/36327] util.JVMClusterUtil(257): Found active master hash=437664465, stopped=false 2023-02-19 20:00:21,138 INFO [Listener at localhost/36327] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:21,140 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:21,140 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:21,140 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:21,140 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:21,140 INFO [Listener at localhost/36327] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:21,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:21,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:21,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:21,142 DEBUG [Listener at localhost/36327] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309719a9 to 127.0.0.1:49975 2023-02-19 20:00:21,143 DEBUG [Listener at localhost/36327] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,143 INFO [Listener at localhost/36327] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44625,1676836814716' ***** 2023-02-19 20:00:21,143 INFO [Listener at localhost/36327] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:21,143 INFO [Listener at localhost/36327] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39727,1676836814764' ***** 2023-02-19 20:00:21,143 INFO [Listener at localhost/36327] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:21,143 INFO [RS:1;jenkins-hbase4:39727] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:21,143 INFO [RS:0;jenkins-hbase4:44625] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:21,143 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:21,143 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:21,143 INFO [RS:1;jenkins-hbase4:39727] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:21,143 INFO [RS:0;jenkins-hbase4:44625] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:21,145 INFO [RS:1;jenkins-hbase4:39727] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:21,145 INFO [RS:0;jenkins-hbase4:44625] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:21,145 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(3304): Received CLOSE for a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:21,145 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(3304): Received CLOSE for eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:21,145 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(3304): Received CLOSE for a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:21,146 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(3304): Received CLOSE for 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:21,146 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(3304): Received CLOSE for c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a75a9bd67f43a3b8627d7db0093b781c, disabling compactions & flushes 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing eb4e6a1bb5ae931941c1eadc44955ab8, disabling compactions & flushes 2023-02-19 20:00:21,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,146 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(3304): Received CLOSE for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. after waiting 0 ms 2023-02-19 20:00:21,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:21,146 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(3304): Received CLOSE for a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:21,146 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(3304): Received CLOSE for 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,146 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(3304): Received CLOSE for 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:21,146 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(3304): Received CLOSE for 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. after waiting 0 ms 2023-02-19 20:00:21,146 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,146 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(3304): Received CLOSE for 604bddcb84a7eb78bface62a9c2e3f3d 2023-02-19 20:00:21,147 DEBUG [RS:0;jenkins-hbase4:44625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62ca5a72 to 127.0.0.1:49975 2023-02-19 20:00:21,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:21,147 DEBUG [RS:0;jenkins-hbase4:44625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,147 INFO [RS:0;jenkins-hbase4:44625] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:21,147 INFO [RS:0;jenkins-hbase4:44625] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:21,147 INFO [RS:0;jenkins-hbase4:44625] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:21,147 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:21,147 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,147 DEBUG [RS:1;jenkins-hbase4:39727] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2f2e48 to 127.0.0.1:49975 2023-02-19 20:00:21,147 DEBUG [RS:1;jenkins-hbase4:39727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,147 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-19 20:00:21,147 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-19 20:00:21,147 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1479): Online Regions={eb4e6a1bb5ae931941c1eadc44955ab8=testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8., c822ba6fa4a0effbce78a988df647fff=testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff., 1588230740=hbase:meta,,1.1588230740, a760f4b3ba63ba53103221e7207530f0=testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0., 57787c23882d1df6527b23d74d9abfc6=testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6., 157e11998255e4a6d006d0111450907f=testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.} 2023-02-19 20:00:21,147 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1479): Online Regions={a75a9bd67f43a3b8627d7db0093b781c=testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c., a5489ae59e238c8b9b5657e1a150c603=testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603., 660288a1f71c9f92897e3f7a01d61102=testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102., 68f9f5d0e07ecec8aa0b7f0aaa32ddb8=testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8., 9d14b50096bf679b49ba9004006e37fa=testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa., 604bddcb84a7eb78bface62a9c2e3f3d=hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d.} 2023-02-19 20:00:21,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:21,148 DEBUG [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1505): Waiting on 157e11998255e4a6d006d0111450907f, 1588230740, 57787c23882d1df6527b23d74d9abfc6, a760f4b3ba63ba53103221e7207530f0, c822ba6fa4a0effbce78a988df647fff, eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:21,148 DEBUG [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1505): Waiting on 604bddcb84a7eb78bface62a9c2e3f3d, 660288a1f71c9f92897e3f7a01d61102, 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, 9d14b50096bf679b49ba9004006e37fa, a5489ae59e238c8b9b5657e1a150c603, a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:21,148 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:21,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:21,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:21,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:21,148 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-19 20:00:21,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 20:00:21,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:21,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a5489ae59e238c8b9b5657e1a150c603, disabling compactions & flushes 2023-02-19 20:00:21,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:21,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:21,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. after waiting 0 ms 2023-02-19 20:00:21,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:21,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 20:00:21,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c822ba6fa4a0effbce78a988df647fff, disabling compactions & flushes 2023-02-19 20:00:21,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. after waiting 0 ms 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:21,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,175 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 20:00:21,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:21,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:21,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:21,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 660288a1f71c9f92897e3f7a01d61102, disabling compactions & flushes 2023-02-19 20:00:21,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:21,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:21,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. after waiting 0 ms 2023-02-19 20:00:21,180 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:21,183 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:21,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:21,186 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 20:00:21,186 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 20:00:21,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/.tmp/info/7823d85a20074afd9a4d509f63fdfcc4 2023-02-19 20:00:21,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:21,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:21,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:21,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a760f4b3ba63ba53103221e7207530f0, disabling compactions & flushes 2023-02-19 20:00:21,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:21,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:21,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. after waiting 0 ms 2023-02-19 20:00:21,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:21,203 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 20:00:21,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:21,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:21,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:21,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, disabling compactions & flushes 2023-02-19 20:00:21,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:21,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:21,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. after waiting 0 ms 2023-02-19 20:00:21,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:21,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,221 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 20:00:21,221 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 20:00:21,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:21,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:21,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:21,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9d14b50096bf679b49ba9004006e37fa, disabling compactions & flushes 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 57787c23882d1df6527b23d74d9abfc6, disabling compactions & flushes 2023-02-19 20:00:21,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:21,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. after waiting 0 ms 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. after waiting 0 ms 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:21,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:21,229 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/.tmp/table/8350e76cccaf42e09435468e24be1661 2023-02-19 20:00:21,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:21,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 157e11998255e4a6d006d0111450907f, disabling compactions & flushes 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 604bddcb84a7eb78bface62a9c2e3f3d, disabling compactions & flushes 2023-02-19 20:00:21,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:21,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:21,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:21,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:21,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. after waiting 0 ms 2023-02-19 20:00:21,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:21,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 604bddcb84a7eb78bface62a9c2e3f3d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:21,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. after waiting 0 ms 2023-02-19 20:00:21,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:21,239 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/.tmp/info/7823d85a20074afd9a4d509f63fdfcc4 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/info/7823d85a20074afd9a4d509f63fdfcc4 2023-02-19 20:00:21,245 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/info/7823d85a20074afd9a4d509f63fdfcc4, entries=110, sequenceid=32, filesize=18.7 K 2023-02-19 20:00:21,246 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/.tmp/table/8350e76cccaf42e09435468e24be1661 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/table/8350e76cccaf42e09435468e24be1661 2023-02-19 20:00:21,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/table/8350e76cccaf42e09435468e24be1661, entries=4, sequenceid=32, filesize=4.8 K 2023-02-19 20:00:21,258 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 110ms, sequenceid=32, compaction requested=false 2023-02-19 20:00:21,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:21,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:21,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:21,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:21,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-19 20:00:21,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:21,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:21,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:21,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:21,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/.tmp/info/76304f23c320440c8abc0cd2b8194667 2023-02-19 20:00:21,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/.tmp/info/76304f23c320440c8abc0cd2b8194667 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/info/76304f23c320440c8abc0cd2b8194667 2023-02-19 20:00:21,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/info/76304f23c320440c8abc0cd2b8194667, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:21,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 604bddcb84a7eb78bface62a9c2e3f3d in 70ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:21,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/data/hbase/namespace/604bddcb84a7eb78bface62a9c2e3f3d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:21,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:21,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 604bddcb84a7eb78bface62a9c2e3f3d: 2023-02-19 20:00:21,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836815523.604bddcb84a7eb78bface62a9c2e3f3d. 2023-02-19 20:00:21,348 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44625,1676836814716; all regions closed. 2023-02-19 20:00:21,348 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39727,1676836814764; all regions closed. 2023-02-19 20:00:21,356 DEBUG [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/oldWALs 2023-02-19 20:00:21,356 INFO [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44625%2C1676836814716.meta:.meta(num 1676836815454) 2023-02-19 20:00:21,357 DEBUG [RS:1;jenkins-hbase4:39727] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/oldWALs 2023-02-19 20:00:21,357 INFO [RS:1;jenkins-hbase4:39727] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39727%2C1676836814764:(num 1676836816251) 2023-02-19 20:00:21,357 DEBUG [RS:1;jenkins-hbase4:39727] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,357 INFO [RS:1;jenkins-hbase4:39727] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:21,358 INFO [RS:1;jenkins-hbase4:39727] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:21,358 INFO [RS:1;jenkins-hbase4:39727] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:21,358 INFO [RS:1;jenkins-hbase4:39727] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:21,358 INFO [RS:1;jenkins-hbase4:39727] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:21,359 INFO [RS:1;jenkins-hbase4:39727] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39727 2023-02-19 20:00:21,359 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:21,362 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,362 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:21,363 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39727,1676836814764 2023-02-19 20:00:21,363 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:21,363 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:21,364 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39727,1676836814764] 2023-02-19 20:00:21,364 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39727,1676836814764; numProcessing=1 2023-02-19 20:00:21,365 DEBUG [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/oldWALs 2023-02-19 20:00:21,365 INFO [RS:0;jenkins-hbase4:44625] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44625%2C1676836814716:(num 1676836816223) 2023-02-19 20:00:21,365 DEBUG [RS:0;jenkins-hbase4:44625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,365 INFO [RS:0;jenkins-hbase4:44625] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:21,366 INFO [RS:0;jenkins-hbase4:44625] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:21,366 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39727,1676836814764 already deleted, retry=false 2023-02-19 20:00:21,366 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:21,366 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39727,1676836814764 expired; onlineServers=1 2023-02-19 20:00:21,367 INFO [RS:0;jenkins-hbase4:44625] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44625 2023-02-19 20:00:21,370 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44625,1676836814716 2023-02-19 20:00:21,370 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:21,372 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44625,1676836814716] 2023-02-19 20:00:21,372 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44625,1676836814716; numProcessing=2 2023-02-19 20:00:21,373 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44625,1676836814716 already deleted, retry=false 2023-02-19 20:00:21,373 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44625,1676836814716 expired; onlineServers=0 2023-02-19 20:00:21,373 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35285,1676836814639' ***** 2023-02-19 20:00:21,373 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:21,374 DEBUG [M:0;jenkins-hbase4:35285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b2b30ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:21,374 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35285,1676836814639 2023-02-19 20:00:21,374 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35285,1676836814639; all regions closed. 2023-02-19 20:00:21,374 DEBUG [M:0;jenkins-hbase4:35285] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:21,374 DEBUG [M:0;jenkins-hbase4:35285] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:21,374 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:21,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836815035] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836815035,5,FailOnTimeoutGroup] 2023-02-19 20:00:21,374 DEBUG [M:0;jenkins-hbase4:35285] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:21,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836815032] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836815032,5,FailOnTimeoutGroup] 2023-02-19 20:00:21,376 INFO [M:0;jenkins-hbase4:35285] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:21,376 INFO [M:0;jenkins-hbase4:35285] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:21,376 INFO [M:0;jenkins-hbase4:35285] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:21,376 DEBUG [M:0;jenkins-hbase4:35285] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:21,376 INFO [M:0;jenkins-hbase4:35285] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:21,377 ERROR [M:0;jenkins-hbase4:35285] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 20:00:21,377 INFO [M:0;jenkins-hbase4:35285] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:21,377 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:21,377 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:21,377 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:21,377 DEBUG [M:0;jenkins-hbase4:35285] zookeeper.ZKUtil(398): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:21,377 WARN [M:0;jenkins-hbase4:35285] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:21,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:21,377 INFO [M:0;jenkins-hbase4:35285] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:21,378 INFO [M:0;jenkins-hbase4:35285] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:21,378 DEBUG [M:0;jenkins-hbase4:35285] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:21,378 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:21,378 DEBUG [M:0;jenkins-hbase4:35285] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:21,378 DEBUG [M:0;jenkins-hbase4:35285] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:21,378 DEBUG [M:0;jenkins-hbase4:35285] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:21,378 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-19 20:00:21,387 INFO [M:0;jenkins-hbase4:35285] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8948899c01ee4f3198dabed75354f356 2023-02-19 20:00:21,392 DEBUG [M:0;jenkins-hbase4:35285] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8948899c01ee4f3198dabed75354f356 as hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8948899c01ee4f3198dabed75354f356 2023-02-19 20:00:21,396 INFO [M:0;jenkins-hbase4:35285] regionserver.HStore(1080): Added hdfs://localhost:34463/user/jenkins/test-data/8d9e410a-a2d0-3f57-075a-a99dbf18a43d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8948899c01ee4f3198dabed75354f356, entries=31, sequenceid=218, filesize=9.0 K 2023-02-19 20:00:21,397 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false 2023-02-19 20:00:21,397 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:21,397 DEBUG [M:0;jenkins-hbase4:35285] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:21,400 INFO [M:0;jenkins-hbase4:35285] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:21,400 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:21,401 INFO [M:0;jenkins-hbase4:35285] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35285 2023-02-19 20:00:21,405 DEBUG [M:0;jenkins-hbase4:35285] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35285,1676836814639 already deleted, retry=false 2023-02-19 20:00:21,640 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:21,640 INFO [M:0;jenkins-hbase4:35285] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35285,1676836814639; zookeeper connection closed. 2023-02-19 20:00:21,641 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c6f48de rejected from java.util.concurrent.ThreadPoolExecutor@850cd8b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:21,641 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): master:35285-0x1006e2b28d50000, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:21,642 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a0aaaca rejected from java.util.concurrent.ThreadPoolExecutor@850cd8b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:21,741 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:21,741 INFO [RS:0;jenkins-hbase4:44625] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44625,1676836814716; zookeeper connection closed. 2023-02-19 20:00:21,741 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5abebcc3 rejected from java.util.concurrent.ThreadPoolExecutor@5e81334c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 20] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:21,741 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4dd3f2b3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4dd3f2b3 2023-02-19 20:00:21,741 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:44625-0x1006e2b28d50001, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:21,741 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@525b50c rejected from java.util.concurrent.ThreadPoolExecutor@5e81334c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 20] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:21,841 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:21,841 INFO [RS:1;jenkins-hbase4:39727] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39727,1676836814764; zookeeper connection closed. 2023-02-19 20:00:21,841 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1621a48c rejected from java.util.concurrent.ThreadPoolExecutor@121e2290[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:21,841 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@51eaad8d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@51eaad8d 2023-02-19 20:00:21,841 DEBUG [Listener at localhost/36327-EventThread] zookeeper.ZKWatcher(600): regionserver:39727-0x1006e2b28d50002, quorum=127.0.0.1:49975, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:21,841 ERROR [Listener at localhost/36327-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d1f44fd rejected from java.util.concurrent.ThreadPoolExecutor@121e2290[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:21,841 INFO [Listener at localhost/36327] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:21,929 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop-5082192318062877055.jar 2023-02-19 20:00:21,934 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676836817830 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:21,934 DEBUG [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce 2023-02-19 20:00:21,935 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:21,935 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:21,935 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:21,935 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(239): region to add: 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=eb4e6a1bb5ae931941c1eadc44955ab8 as eb4e6a1bb5ae931941c1eadc44955ab8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=a75a9bd67f43a3b8627d7db0093b781c as a75a9bd67f43a3b8627d7db0093b781c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=c822ba6fa4a0effbce78a988df647fff as c822ba6fa4a0effbce78a988df647fff in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,936 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=a5489ae59e238c8b9b5657e1a150c603 as a5489ae59e238c8b9b5657e1a150c603 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,937 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=660288a1f71c9f92897e3f7a01d61102 as 660288a1f71c9f92897e3f7a01d61102 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,937 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=a760f4b3ba63ba53103221e7207530f0 as a760f4b3ba63ba53103221e7207530f0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,937 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=57787c23882d1df6527b23d74d9abfc6 as 57787c23882d1df6527b23d74d9abfc6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,937 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=68f9f5d0e07ecec8aa0b7f0aaa32ddb8 as 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,937 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=9d14b50096bf679b49ba9004006e37fa as 9d14b50096bf679b49ba9004006e37fa in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,937 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(585): clone region=157e11998255e4a6d006d0111450907f as 157e11998255e4a6d006d0111450907f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 20:00:21,938 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => eb4e6a1bb5ae931941c1eadc44955ab8, NAME => 'testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,938 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => a75a9bd67f43a3b8627d7db0093b781c, NAME => 'testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,939 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c822ba6fa4a0effbce78a988df647fff, NAME => 'testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,940 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 660288a1f71c9f92897e3f7a01d61102, NAME => 'testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,941 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => a760f4b3ba63ba53103221e7207530f0, NAME => 'testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,941 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 57787c23882d1df6527b23d74d9abfc6, NAME => 'testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,941 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => a5489ae59e238c8b9b5657e1a150c603, NAME => 'testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,941 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, NAME => 'testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,972 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:21,972 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4332c8a50b3f4dfc8b16d5720392d5f7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,976 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:21,976 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing a75a9bd67f43a3b8627d7db0093b781c, disabling compactions & flushes 2023-02-19 20:00:21,976 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,977 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,977 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. after waiting 0 ms 2023-02-19 20:00:21,977 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,977 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:21,977 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:21,977 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9d14b50096bf679b49ba9004006e37fa, NAME => 'testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:21,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:21,983 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ce83ef88bfa477bba8e8e47f5bae09b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,983 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:21,983 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 356028d1410c4a27ab004f07be6f5586 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,983 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:21,983 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9eb99d3133c84f5cb5cd30e8c62d7e76 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,996 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:21,997 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 526bd1e9dd2b4bef916312de69a2092a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,998 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a1d3e6cbb9024b0798b0427c57615116 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,998 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 58a38e8c203b44aab72d29231fd8d5ff from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,998 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0fc7d0f30bd5448982c0cc05c598b357 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:21,999 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8682d504fd334fb592c39f166aeb19ad from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, disabling compactions & flushes 2023-02-19 20:00:22,008 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 660288a1f71c9f92897e3f7a01d61102, disabling compactions & flushes 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing a5489ae59e238c8b9b5657e1a150c603, disabling compactions & flushes 2023-02-19 20:00:22,008 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,008 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dabd7bdbad7a4622a63bfe95cfabbea2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,008 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3f818a8ad1884238a4ce6c8da8d7ee02 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. after waiting 0 ms 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing a760f4b3ba63ba53103221e7207530f0, disabling compactions & flushes 2023-02-19 20:00:22,008 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,008 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. after waiting 0 ms 2023-02-19 20:00:22,009 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:22,009 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,009 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. after waiting 0 ms 2023-02-19 20:00:22,009 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. after waiting 0 ms 2023-02-19 20:00:22,010 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:22,010 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:22,010 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:22,010 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 157e11998255e4a6d006d0111450907f, NAME => 'testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:22,020 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,020 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f9e2494a9114fb793dfc158f6aed936 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,020 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f40e1441be2a421297284c783f1e3f40 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,020 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c822ba6fa4a0effbce78a988df647fff, disabling compactions & flushes 2023-02-19 20:00:22,021 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:22,021 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:22,021 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. after waiting 0 ms 2023-02-19 20:00:22,021 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:22,021 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:22,021 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:22,024 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3c12059feb3433384f59b2658a68f28 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,025 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 57787c23882d1df6527b23d74d9abfc6, disabling compactions & flushes 2023-02-19 20:00:22,025 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:22,025 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:22,025 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. after waiting 0 ms 2023-02-19 20:00:22,025 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:22,025 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:22,025 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:22,027 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 9d14b50096bf679b49ba9004006e37fa, disabling compactions & flushes 2023-02-19 20:00:22,027 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:22,027 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:22,027 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. after waiting 0 ms 2023-02-19 20:00:22,027 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:22,027 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:22,027 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:22,028 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,028 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 845161bf813e4c86b07ee43b664b43da from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,032 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b555679aafdc4b3bae0490e5d362558d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 20:00:22,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 157e11998255e4a6d006d0111450907f, disabling compactions & flushes 2023-02-19 20:00:22,034 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. after waiting 0 ms 2023-02-19 20:00:22,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,034 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:22,360 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing eb4e6a1bb5ae931941c1eadc44955ab8, disabling compactions & flushes 2023-02-19 20:00:22,361 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:22,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:22,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. after waiting 0 ms 2023-02-19 20:00:22,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:22,361 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:22,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:22,361 INFO [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676836817830 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:22,362 DEBUG [Listener at localhost/36327] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:22,362 DEBUG [Listener at localhost/36327] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2 2023-02-19 20:00:22,363 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:22,363 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:22,364 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 20:00:22,364 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------157e11998255e4a6d006d0111450907f/ 2023-02-19 20:00:22,365 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,365 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,366 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=157e11998255e4a6d006d0111450907f-845161bf813e4c86b07ee43b664b43da 2023-02-19 20:00:22,366 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,366 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=157e11998255e4a6d006d0111450907f-b555679aafdc4b3bae0490e5d362558d 2023-02-19 20:00:22,366 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------57787c23882d1df6527b23d74d9abfc6/ 2023-02-19 20:00:22,367 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,367 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,367 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=57787c23882d1df6527b23d74d9abfc6-dabd7bdbad7a4622a63bfe95cfabbea2 2023-02-19 20:00:22,367 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,368 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=57787c23882d1df6527b23d74d9abfc6-7f9e2494a9114fb793dfc158f6aed936 2023-02-19 20:00:22,368 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------660288a1f71c9f92897e3f7a01d61102/ 2023-02-19 20:00:22,368 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,368 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,369 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=660288a1f71c9f92897e3f7a01d61102-3ce83ef88bfa477bba8e8e47f5bae09b 2023-02-19 20:00:22,369 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,369 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=660288a1f71c9f92897e3f7a01d61102-8682d504fd334fb592c39f166aeb19ad 2023-02-19 20:00:22,369 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------68f9f5d0e07ecec8aa0b7f0aaa32ddb8/ 2023-02-19 20:00:22,370 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,370 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,370 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=68f9f5d0e07ecec8aa0b7f0aaa32ddb8-4332c8a50b3f4dfc8b16d5720392d5f7 2023-02-19 20:00:22,370 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,371 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=68f9f5d0e07ecec8aa0b7f0aaa32ddb8-0fc7d0f30bd5448982c0cc05c598b357 2023-02-19 20:00:22,371 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------9d14b50096bf679b49ba9004006e37fa/ 2023-02-19 20:00:22,371 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,371 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,372 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=9d14b50096bf679b49ba9004006e37fa-f40e1441be2a421297284c783f1e3f40 2023-02-19 20:00:22,372 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,372 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=9d14b50096bf679b49ba9004006e37fa-f3c12059feb3433384f59b2658a68f28 2023-02-19 20:00:22,372 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------a5489ae59e238c8b9b5657e1a150c603/ 2023-02-19 20:00:22,373 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,373 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,373 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=a5489ae59e238c8b9b5657e1a150c603-9eb99d3133c84f5cb5cd30e8c62d7e76 2023-02-19 20:00:22,374 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,374 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=a5489ae59e238c8b9b5657e1a150c603-a1d3e6cbb9024b0798b0427c57615116 2023-02-19 20:00:22,374 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------a75a9bd67f43a3b8627d7db0093b781c/ 2023-02-19 20:00:22,374 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,375 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------a760f4b3ba63ba53103221e7207530f0/ 2023-02-19 20:00:22,375 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,375 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,375 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=a760f4b3ba63ba53103221e7207530f0-356028d1410c4a27ab004f07be6f5586 2023-02-19 20:00:22,376 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,376 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=a760f4b3ba63ba53103221e7207530f0-58a38e8c203b44aab72d29231fd8d5ff 2023-02-19 20:00:22,376 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------c822ba6fa4a0effbce78a988df647fff/ 2023-02-19 20:00:22,377 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,377 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:22,377 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=c822ba6fa4a0effbce78a988df647fff-526bd1e9dd2b4bef916312de69a2092a 2023-02-19 20:00:22,377 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:22,378 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |----------------testWithMapReduce=c822ba6fa4a0effbce78a988df647fff-3f818a8ad1884238a4ce6c8da8d7ee02 2023-02-19 20:00:22,378 DEBUG [Listener at localhost/36327] util.CommonFSUtils(699): |----------eb4e6a1bb5ae931941c1eadc44955ab8/ 2023-02-19 20:00:22,378 DEBUG [Listener at localhost/36327] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:22,379 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,380 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,380 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,381 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,381 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,382 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,382 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,460 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop-3006582829454265313.jar 2023-02-19 20:00:22,461 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,462 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,462 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,463 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,463 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,463 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,464 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 20:00:22,464 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 20:00:22,465 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 20:00:22,465 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 20:00:22,465 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 20:00:22,466 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 20:00:22,466 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 20:00:22,467 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 20:00:22,467 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 20:00:22,467 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 20:00:22,468 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:22,468 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:22,469 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:22,469 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:22,469 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 20:00:22,541 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop-1412349886384767907.jar 2023-02-19 20:00:22,542 DEBUG [Listener at localhost/36327] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 20:00:22,549 WARN [Listener at localhost/36327] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 20:00:22,582 INFO [Listener at localhost/36327] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 20:00:22,709 WARN [Listener at localhost/36327] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/mapreduce.cluster.local.dir/1676836822676/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 20:00:22,709 WARN [Listener at localhost/36327] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/mapreduce.cluster.local.dir/1676836822676/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 20:00:22,741 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:22,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,764 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:22,765 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:22,767 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:22,768 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1 2023-02-19 20:00:22,769 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 157e11998255e4a6d006d0111450907f columnFamilyName f1 2023-02-19 20:00:22,775 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f1/testWithMapReduce=157e11998255e4a6d006d0111450907f-845161bf813e4c86b07ee43b664b43da 2023-02-19 20:00:22,775 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(310): Store=157e11998255e4a6d006d0111450907f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,775 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 157e11998255e4a6d006d0111450907f 2023-02-19 20:00:22,776 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2 2023-02-19 20:00:22,777 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 157e11998255e4a6d006d0111450907f columnFamilyName f2 2023-02-19 20:00:22,782 DEBUG [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/157e11998255e4a6d006d0111450907f/f2/testWithMapReduce=157e11998255e4a6d006d0111450907f-b555679aafdc4b3bae0490e5d362558d 2023-02-19 20:00:22,782 INFO [StoreOpener-157e11998255e4a6d006d0111450907f-1] regionserver.HStore(310): Store=157e11998255e4a6d006d0111450907f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:22,783 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 157e11998255e4a6d006d0111450907f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62858420, jitterRate=-0.06333655118942261}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:22,783 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:22,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 157e11998255e4a6d006d0111450907f, disabling compactions & flushes 2023-02-19 20:00:22,828 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. after waiting 0 ms 2023-02-19 20:00:22,828 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,829 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676836816427.157e11998255e4a6d006d0111450907f. 2023-02-19 20:00:22,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 157e11998255e4a6d006d0111450907f: 2023-02-19 20:00:22,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,833 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:22,834 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:22,836 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:22,837 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1 2023-02-19 20:00:22,838 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 columnFamilyName f1 2023-02-19 20:00:22,842 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1/testWithMapReduce=68f9f5d0e07ecec8aa0b7f0aaa32ddb8-4332c8a50b3f4dfc8b16d5720392d5f7 2023-02-19 20:00:22,843 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(310): Store=68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,843 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 2023-02-19 20:00:22,844 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2 2023-02-19 20:00:22,844 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68f9f5d0e07ecec8aa0b7f0aaa32ddb8 columnFamilyName f2 2023-02-19 20:00:22,848 DEBUG [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2/testWithMapReduce=68f9f5d0e07ecec8aa0b7f0aaa32ddb8-0fc7d0f30bd5448982c0cc05c598b357 2023-02-19 20:00:22,849 INFO [StoreOpener-68f9f5d0e07ecec8aa0b7f0aaa32ddb8-1] regionserver.HStore(310): Store=68f9f5d0e07ecec8aa0b7f0aaa32ddb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,849 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:22,849 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 68f9f5d0e07ecec8aa0b7f0aaa32ddb8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73131085, jitterRate=0.08973808586597443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:22,849 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:22,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 68f9f5d0e07ecec8aa0b7f0aaa32ddb8, disabling compactions & flushes 2023-02-19 20:00:22,878 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. after waiting 0 ms 2023-02-19 20:00:22,878 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,879 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676836816427.68f9f5d0e07ecec8aa0b7f0aaa32ddb8. 2023-02-19 20:00:22,879 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 68f9f5d0e07ecec8aa0b7f0aaa32ddb8: 2023-02-19 20:00:22,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,883 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:22,884 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:22,885 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:22,886 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1 2023-02-19 20:00:22,887 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 660288a1f71c9f92897e3f7a01d61102 columnFamilyName f1 2023-02-19 20:00:22,892 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f1/testWithMapReduce=660288a1f71c9f92897e3f7a01d61102-3ce83ef88bfa477bba8e8e47f5bae09b 2023-02-19 20:00:22,892 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(310): Store=660288a1f71c9f92897e3f7a01d61102/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,892 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 660288a1f71c9f92897e3f7a01d61102 2023-02-19 20:00:22,893 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2 2023-02-19 20:00:22,893 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 660288a1f71c9f92897e3f7a01d61102 columnFamilyName f2 2023-02-19 20:00:22,898 DEBUG [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/660288a1f71c9f92897e3f7a01d61102/f2/testWithMapReduce=660288a1f71c9f92897e3f7a01d61102-8682d504fd334fb592c39f166aeb19ad 2023-02-19 20:00:22,898 INFO [StoreOpener-660288a1f71c9f92897e3f7a01d61102-1] regionserver.HStore(310): Store=660288a1f71c9f92897e3f7a01d61102/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,898 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:22,898 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 660288a1f71c9f92897e3f7a01d61102; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71334507, jitterRate=0.06296698749065399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:22,898 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:22,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 660288a1f71c9f92897e3f7a01d61102, disabling compactions & flushes 2023-02-19 20:00:22,930 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. after waiting 0 ms 2023-02-19 20:00:22,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,931 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676836816427.660288a1f71c9f92897e3f7a01d61102. 2023-02-19 20:00:22,931 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 660288a1f71c9f92897e3f7a01d61102: 2023-02-19 20:00:22,935 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:22,935 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:22,936 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:22,938 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:22,940 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1 2023-02-19 20:00:22,940 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5489ae59e238c8b9b5657e1a150c603 columnFamilyName f1 2023-02-19 20:00:22,945 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f1/testWithMapReduce=a5489ae59e238c8b9b5657e1a150c603-9eb99d3133c84f5cb5cd30e8c62d7e76 2023-02-19 20:00:22,946 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(310): Store=a5489ae59e238c8b9b5657e1a150c603/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,946 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5489ae59e238c8b9b5657e1a150c603 2023-02-19 20:00:22,947 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2 2023-02-19 20:00:22,947 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5489ae59e238c8b9b5657e1a150c603 columnFamilyName f2 2023-02-19 20:00:22,952 DEBUG [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a5489ae59e238c8b9b5657e1a150c603/f2/testWithMapReduce=a5489ae59e238c8b9b5657e1a150c603-a1d3e6cbb9024b0798b0427c57615116 2023-02-19 20:00:22,952 INFO [StoreOpener-a5489ae59e238c8b9b5657e1a150c603-1] regionserver.HStore(310): Store=a5489ae59e238c8b9b5657e1a150c603/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:22,952 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:22,953 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a5489ae59e238c8b9b5657e1a150c603; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75345278, jitterRate=0.12273213267326355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:22,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:22,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a5489ae59e238c8b9b5657e1a150c603, disabling compactions & flushes 2023-02-19 20:00:22,999 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:22,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:22,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. after waiting 0 ms 2023-02-19 20:00:22,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:23,001 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676836816427.a5489ae59e238c8b9b5657e1a150c603. 2023-02-19 20:00:23,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a5489ae59e238c8b9b5657e1a150c603: 2023-02-19 20:00:23,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:23,006 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:23,007 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:23,009 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:23,009 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1 2023-02-19 20:00:23,010 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57787c23882d1df6527b23d74d9abfc6 columnFamilyName f1 2023-02-19 20:00:23,015 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f1/testWithMapReduce=57787c23882d1df6527b23d74d9abfc6-dabd7bdbad7a4622a63bfe95cfabbea2 2023-02-19 20:00:23,015 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(310): Store=57787c23882d1df6527b23d74d9abfc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,015 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 57787c23882d1df6527b23d74d9abfc6 2023-02-19 20:00:23,016 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2 2023-02-19 20:00:23,016 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57787c23882d1df6527b23d74d9abfc6 columnFamilyName f2 2023-02-19 20:00:23,022 DEBUG [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/57787c23882d1df6527b23d74d9abfc6/f2/testWithMapReduce=57787c23882d1df6527b23d74d9abfc6-7f9e2494a9114fb793dfc158f6aed936 2023-02-19 20:00:23,022 INFO [StoreOpener-57787c23882d1df6527b23d74d9abfc6-1] regionserver.HStore(310): Store=57787c23882d1df6527b23d74d9abfc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:23,022 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 57787c23882d1df6527b23d74d9abfc6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69408207, jitterRate=0.03426288068294525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:23,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:23,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 57787c23882d1df6527b23d74d9abfc6, disabling compactions & flushes 2023-02-19 20:00:23,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:23,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:23,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. after waiting 0 ms 2023-02-19 20:00:23,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:23,055 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676836816427.57787c23882d1df6527b23d74d9abfc6. 2023-02-19 20:00:23,055 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 57787c23882d1df6527b23d74d9abfc6: 2023-02-19 20:00:23,066 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:23,066 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:23,068 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:23,070 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:23,071 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1 2023-02-19 20:00:23,071 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d14b50096bf679b49ba9004006e37fa columnFamilyName f1 2023-02-19 20:00:23,076 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f1/testWithMapReduce=9d14b50096bf679b49ba9004006e37fa-f40e1441be2a421297284c783f1e3f40 2023-02-19 20:00:23,077 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(310): Store=9d14b50096bf679b49ba9004006e37fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,077 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d14b50096bf679b49ba9004006e37fa 2023-02-19 20:00:23,077 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2 2023-02-19 20:00:23,078 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d14b50096bf679b49ba9004006e37fa columnFamilyName f2 2023-02-19 20:00:23,082 DEBUG [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/9d14b50096bf679b49ba9004006e37fa/f2/testWithMapReduce=9d14b50096bf679b49ba9004006e37fa-f3c12059feb3433384f59b2658a68f28 2023-02-19 20:00:23,082 INFO [StoreOpener-9d14b50096bf679b49ba9004006e37fa-1] regionserver.HStore(310): Store=9d14b50096bf679b49ba9004006e37fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:23,082 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9d14b50096bf679b49ba9004006e37fa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64448161, jitterRate=-0.03964756429195404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:23,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:23,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9d14b50096bf679b49ba9004006e37fa, disabling compactions & flushes 2023-02-19 20:00:23,111 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:23,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:23,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. after waiting 0 ms 2023-02-19 20:00:23,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:23,112 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676836816427.9d14b50096bf679b49ba9004006e37fa. 2023-02-19 20:00:23,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9d14b50096bf679b49ba9004006e37fa: 2023-02-19 20:00:23,115 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:23,115 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:23,116 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:23,118 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:23,119 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1 2023-02-19 20:00:23,119 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c822ba6fa4a0effbce78a988df647fff columnFamilyName f1 2023-02-19 20:00:23,124 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f1/testWithMapReduce=c822ba6fa4a0effbce78a988df647fff-526bd1e9dd2b4bef916312de69a2092a 2023-02-19 20:00:23,124 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(310): Store=c822ba6fa4a0effbce78a988df647fff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,124 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c822ba6fa4a0effbce78a988df647fff 2023-02-19 20:00:23,125 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2 2023-02-19 20:00:23,125 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c822ba6fa4a0effbce78a988df647fff columnFamilyName f2 2023-02-19 20:00:23,129 DEBUG [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/c822ba6fa4a0effbce78a988df647fff/f2/testWithMapReduce=c822ba6fa4a0effbce78a988df647fff-3f818a8ad1884238a4ce6c8da8d7ee02 2023-02-19 20:00:23,129 INFO [StoreOpener-c822ba6fa4a0effbce78a988df647fff-1] regionserver.HStore(310): Store=c822ba6fa4a0effbce78a988df647fff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:23,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c822ba6fa4a0effbce78a988df647fff; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74440278, jitterRate=0.10924658179283142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:23,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:23,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c822ba6fa4a0effbce78a988df647fff, disabling compactions & flushes 2023-02-19 20:00:23,157 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:23,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:23,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. after waiting 0 ms 2023-02-19 20:00:23,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:23,158 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676836816427.c822ba6fa4a0effbce78a988df647fff. 2023-02-19 20:00:23,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c822ba6fa4a0effbce78a988df647fff: 2023-02-19 20:00:23,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:23,161 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:23,162 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:23,163 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:23,165 DEBUG [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/f1 2023-02-19 20:00:23,165 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a75a9bd67f43a3b8627d7db0093b781c columnFamilyName f1 2023-02-19 20:00:23,165 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(310): Store=a75a9bd67f43a3b8627d7db0093b781c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,166 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a75a9bd67f43a3b8627d7db0093b781c 2023-02-19 20:00:23,167 DEBUG [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a75a9bd67f43a3b8627d7db0093b781c/f2 2023-02-19 20:00:23,167 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a75a9bd67f43a3b8627d7db0093b781c columnFamilyName f2 2023-02-19 20:00:23,168 INFO [StoreOpener-a75a9bd67f43a3b8627d7db0093b781c-1] regionserver.HStore(310): Store=a75a9bd67f43a3b8627d7db0093b781c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:23,168 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a75a9bd67f43a3b8627d7db0093b781c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73753527, jitterRate=0.09901319444179535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:23,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:23,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a75a9bd67f43a3b8627d7db0093b781c, disabling compactions & flushes 2023-02-19 20:00:23,192 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:23,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:23,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. after waiting 0 ms 2023-02-19 20:00:23,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:23,193 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836816427.a75a9bd67f43a3b8627d7db0093b781c. 2023-02-19 20:00:23,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a75a9bd67f43a3b8627d7db0093b781c: 2023-02-19 20:00:23,196 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:23,196 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:23,197 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:23,199 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:23,200 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1 2023-02-19 20:00:23,200 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a760f4b3ba63ba53103221e7207530f0 columnFamilyName f1 2023-02-19 20:00:23,204 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f1/testWithMapReduce=a760f4b3ba63ba53103221e7207530f0-356028d1410c4a27ab004f07be6f5586 2023-02-19 20:00:23,205 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(310): Store=a760f4b3ba63ba53103221e7207530f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,205 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a760f4b3ba63ba53103221e7207530f0 2023-02-19 20:00:23,205 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2 2023-02-19 20:00:23,206 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a760f4b3ba63ba53103221e7207530f0 columnFamilyName f2 2023-02-19 20:00:23,210 DEBUG [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(539): loaded hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/a760f4b3ba63ba53103221e7207530f0/f2/testWithMapReduce=a760f4b3ba63ba53103221e7207530f0-58a38e8c203b44aab72d29231fd8d5ff 2023-02-19 20:00:23,210 INFO [StoreOpener-a760f4b3ba63ba53103221e7207530f0-1] regionserver.HStore(310): Store=a760f4b3ba63ba53103221e7207530f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,210 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:23,210 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a760f4b3ba63ba53103221e7207530f0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65135380, jitterRate=-0.029407203197479248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:23,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:23,238 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a760f4b3ba63ba53103221e7207530f0, disabling compactions & flushes 2023-02-19 20:00:23,239 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:23,239 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:23,239 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. after waiting 0 ms 2023-02-19 20:00:23,239 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:23,240 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676836816427.a760f4b3ba63ba53103221e7207530f0. 2023-02-19 20:00:23,240 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a760f4b3ba63ba53103221e7207530f0: 2023-02-19 20:00:23,244 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:23,244 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:23,245 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:23,248 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:23,250 DEBUG [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/f1 2023-02-19 20:00:23,250 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb4e6a1bb5ae931941c1eadc44955ab8 columnFamilyName f1 2023-02-19 20:00:23,251 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(310): Store=eb4e6a1bb5ae931941c1eadc44955ab8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,251 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eb4e6a1bb5ae931941c1eadc44955ab8 2023-02-19 20:00:23,253 DEBUG [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34463/user/jenkins/test-data/f4e8ce56-4573-f0cb-73d1-de5ce1399dc2/testWithMapReduceAndOfflineHBaseMultiRegion/6bad1564-fabf-4b6d-b721-c9f1b974b7e2/data/default/testWithMapReduce/eb4e6a1bb5ae931941c1eadc44955ab8/f2 2023-02-19 20:00:23,253 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb4e6a1bb5ae931941c1eadc44955ab8 columnFamilyName f2 2023-02-19 20:00:23,255 INFO [StoreOpener-eb4e6a1bb5ae931941c1eadc44955ab8-1] regionserver.HStore(310): Store=eb4e6a1bb5ae931941c1eadc44955ab8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:23,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:23,256 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened eb4e6a1bb5ae931941c1eadc44955ab8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75175978, jitterRate=0.12020936608314514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:23,256 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:23,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing eb4e6a1bb5ae931941c1eadc44955ab8, disabling compactions & flushes 2023-02-19 20:00:23,276 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:23,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:23,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. after waiting 0 ms 2023-02-19 20:00:23,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:23,277 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676836816427.eb4e6a1bb5ae931941c1eadc44955ab8. 2023-02-19 20:00:23,277 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for eb4e6a1bb5ae931941c1eadc44955ab8: 2023-02-19 20:00:23,763 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:23,763 WARN [Listener at localhost/36327] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:23,766 INFO [Listener at localhost/36327] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:23,875 WARN [BP-2000788758-172.31.14.131-1676836813816 heartbeating to localhost/127.0.0.1:34463] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:23,875 WARN [BP-2000788758-172.31.14.131-1676836813816 heartbeating to localhost/127.0.0.1:34463] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2000788758-172.31.14.131-1676836813816 (Datanode Uuid 27a6c4ca-716f-4713-8017-12fa6dd05204) service to localhost/127.0.0.1:34463 2023-02-19 20:00:23,875 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/dfs/data/data3/current/BP-2000788758-172.31.14.131-1676836813816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:23,876 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/dfs/data/data4/current/BP-2000788758-172.31.14.131-1676836813816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:23,878 WARN [Listener at localhost/36327] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:23,880 INFO [Listener at localhost/36327] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:23,983 WARN [BP-2000788758-172.31.14.131-1676836813816 heartbeating to localhost/127.0.0.1:34463] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:23,983 WARN [BP-2000788758-172.31.14.131-1676836813816 heartbeating to localhost/127.0.0.1:34463] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2000788758-172.31.14.131-1676836813816 (Datanode Uuid a00e51db-a212-407a-8947-05058c2fd655) service to localhost/127.0.0.1:34463 2023-02-19 20:00:23,983 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/dfs/data/data1/current/BP-2000788758-172.31.14.131-1676836813816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:23,984 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/cluster_9f8e8706-8c25-1802-40f4-7d44fbb6ac7a/dfs/data/data2/current/BP-2000788758-172.31.14.131-1676836813816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:23,993 INFO [Listener at localhost/36327] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:24,112 INFO [Listener at localhost/36327] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:24,155 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:24,168 INFO [Listener at localhost/36327] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=156 (was 104) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:34463 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:34463 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36327 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:34463 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34463 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35285,1676836814639)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:34463 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:34463 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:34463 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=539 (was 544), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=434 (was 351) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=9286 (was 9903) 2023-02-19 20:00:24,178 INFO [Listener at localhost/36327] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=156, OpenFileDescriptor=539, MaxFileDescriptor=60000, SystemLoadAverage=434, ProcessCount=170, AvailableMemoryMB=9286 2023-02-19 20:00:24,188 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop.log.dir so I do NOT create it in target/test-data/70658180-e98f-303c-fa97-9d6b845d609f 2023-02-19 20:00:24,188 WARN [Listener at localhost/36327] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 20:00:24,188 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop.tmp.dir so I do NOT create it in target/test-data/70658180-e98f-303c-fa97-9d6b845d609f 2023-02-19 20:00:24,188 WARN [Listener at localhost/36327] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bebd3f1-dabe-ccbe-d118-813f9be91194/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 20:00:24,188 DEBUG [Listener at localhost/36327] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f 2023-02-19 20:00:24,188 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:00:24,188 INFO [Listener at localhost/36327] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325, deleteOnExit=true 2023-02-19 20:00:24,188 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:00:24,188 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/test.cache.data in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:00:24,189 DEBUG [Listener at localhost/36327] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:24,189 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:00:24,190 INFO [Listener at localhost/36327] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:00:24,194 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:24,195 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:24,240 WARN [Listener at localhost/36327] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:24,242 INFO [Listener at localhost/36327] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:24,247 INFO [Listener at localhost/36327] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/java.io.tmpdir/Jetty_localhost_45041_hdfs____cc408m/webapp 2023-02-19 20:00:24,350 INFO [Listener at localhost/36327] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45041 2023-02-19 20:00:24,354 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:24,354 WARN [Listener at localhost/36327] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:24,396 WARN [Listener at localhost/41191] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:24,406 WARN [Listener at localhost/41191] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:24,408 WARN [Listener at localhost/41191] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:24,409 INFO [Listener at localhost/41191] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:24,413 INFO [Listener at localhost/41191] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/java.io.tmpdir/Jetty_localhost_38745_datanode____.uzzmsm/webapp 2023-02-19 20:00:24,504 INFO [Listener at localhost/41191] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38745 2023-02-19 20:00:24,512 WARN [Listener at localhost/43855] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:24,538 WARN [Listener at localhost/43855] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:24,540 WARN [Listener at localhost/43855] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:24,541 INFO [Listener at localhost/43855] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:24,545 INFO [Listener at localhost/43855] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/java.io.tmpdir/Jetty_localhost_46573_datanode____e213zq/webapp 2023-02-19 20:00:24,626 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc65dd6fa2bfd5d35: Processing first storage report for DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4 from datanode 3491d068-45a7-48b3-8184-9a1176de327f 2023-02-19 20:00:24,627 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc65dd6fa2bfd5d35: from storage DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4 node DatanodeRegistration(127.0.0.1:46575, datanodeUuid=3491d068-45a7-48b3-8184-9a1176de327f, infoPort=36351, infoSecurePort=0, ipcPort=43855, storageInfo=lv=-57;cid=testClusterID;nsid=1716997276;c=1676836824197), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:24,627 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc65dd6fa2bfd5d35: Processing first storage report for DS-78506a43-3b44-401e-9e48-9818e20b50eb from datanode 3491d068-45a7-48b3-8184-9a1176de327f 2023-02-19 20:00:24,627 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc65dd6fa2bfd5d35: from storage DS-78506a43-3b44-401e-9e48-9818e20b50eb node DatanodeRegistration(127.0.0.1:46575, datanodeUuid=3491d068-45a7-48b3-8184-9a1176de327f, infoPort=36351, infoSecurePort=0, ipcPort=43855, storageInfo=lv=-57;cid=testClusterID;nsid=1716997276;c=1676836824197), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:24,649 INFO [Listener at localhost/43855] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46573 2023-02-19 20:00:24,656 WARN [Listener at localhost/45401] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:24,745 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeae3417a6f4800d2: Processing first storage report for DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a from datanode ac6b4f0c-dec4-4a51-b297-8544327a0d67 2023-02-19 20:00:24,745 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeae3417a6f4800d2: from storage DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a node DatanodeRegistration(127.0.0.1:40561, datanodeUuid=ac6b4f0c-dec4-4a51-b297-8544327a0d67, infoPort=43841, infoSecurePort=0, ipcPort=45401, storageInfo=lv=-57;cid=testClusterID;nsid=1716997276;c=1676836824197), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:24,745 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeae3417a6f4800d2: Processing first storage report for DS-1acdd2fe-523b-4c52-95d4-5512cfc17b31 from datanode ac6b4f0c-dec4-4a51-b297-8544327a0d67 2023-02-19 20:00:24,745 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeae3417a6f4800d2: from storage DS-1acdd2fe-523b-4c52-95d4-5512cfc17b31 node DatanodeRegistration(127.0.0.1:40561, datanodeUuid=ac6b4f0c-dec4-4a51-b297-8544327a0d67, infoPort=43841, infoSecurePort=0, ipcPort=45401, storageInfo=lv=-57;cid=testClusterID;nsid=1716997276;c=1676836824197), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:24,762 DEBUG [Listener at localhost/45401] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f 2023-02-19 20:00:24,766 INFO [Listener at localhost/45401] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/zookeeper_0, clientPort=50355, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:00:24,767 INFO [Listener at localhost/45401] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50355 2023-02-19 20:00:24,767 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,768 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,778 INFO [Listener at localhost/45401] util.FSUtils(479): Created version file at hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4 with version=8 2023-02-19 20:00:24,778 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,779 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,780 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41191/user/jenkins/test-data/8890f88a-2951-e3a1-5542-fb30a3041289/hbase-staging 2023-02-19 20:00:24,781 INFO [Listener at localhost/45401] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:24,782 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,782 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,782 INFO [Listener at localhost/45401] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:24,782 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,782 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:24,782 INFO [Listener at localhost/45401] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:24,783 INFO [Listener at localhost/45401] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38635 2023-02-19 20:00:24,783 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,784 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,785 INFO [Listener at localhost/45401] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38635 connecting to ZooKeeper ensemble=127.0.0.1:50355 2023-02-19 20:00:24,791 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:386350x0, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:24,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38635-0x1006e2b50810000 connected 2023-02-19 20:00:24,804 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:24,805 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:24,805 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:24,805 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38635 2023-02-19 20:00:24,806 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38635 2023-02-19 20:00:24,806 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38635 2023-02-19 20:00:24,807 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38635 2023-02-19 20:00:24,807 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38635 2023-02-19 20:00:24,807 INFO [Listener at localhost/45401] master.HMaster(444): hbase.rootdir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4, hbase.cluster.distributed=false 2023-02-19 20:00:24,819 INFO [Listener at localhost/45401] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:24,819 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,819 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,819 INFO [Listener at localhost/45401] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:24,819 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,819 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:24,820 INFO [Listener at localhost/45401] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:24,821 INFO [Listener at localhost/45401] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42365 2023-02-19 20:00:24,821 INFO [Listener at localhost/45401] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:24,822 DEBUG [Listener at localhost/45401] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:24,823 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,823 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,824 INFO [Listener at localhost/45401] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42365 connecting to ZooKeeper ensemble=127.0.0.1:50355 2023-02-19 20:00:24,827 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:423650x0, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:24,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42365-0x1006e2b50810001 connected 2023-02-19 20:00:24,828 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:24,828 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:24,829 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:24,830 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42365 2023-02-19 20:00:24,830 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42365 2023-02-19 20:00:24,830 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42365 2023-02-19 20:00:24,831 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42365 2023-02-19 20:00:24,831 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42365 2023-02-19 20:00:24,841 INFO [Listener at localhost/45401] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:24,841 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,842 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,842 INFO [Listener at localhost/45401] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:24,842 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:24,842 INFO [Listener at localhost/45401] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:24,842 INFO [Listener at localhost/45401] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:24,844 INFO [Listener at localhost/45401] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37839 2023-02-19 20:00:24,844 INFO [Listener at localhost/45401] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:24,845 DEBUG [Listener at localhost/45401] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:24,846 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,847 INFO [Listener at localhost/45401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,847 INFO [Listener at localhost/45401] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37839 connecting to ZooKeeper ensemble=127.0.0.1:50355 2023-02-19 20:00:24,850 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:378390x0, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:24,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37839-0x1006e2b50810002 connected 2023-02-19 20:00:24,853 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:24,853 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:24,854 DEBUG [Listener at localhost/45401] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:24,856 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37839 2023-02-19 20:00:24,856 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37839 2023-02-19 20:00:24,856 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37839 2023-02-19 20:00:24,856 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37839 2023-02-19 20:00:24,857 DEBUG [Listener at localhost/45401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37839 2023-02-19 20:00:24,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:24,859 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:24,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:24,861 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:24,861 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:24,861 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:24,861 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:24,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:24,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:24,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38635,1676836824781 from backup master directory 2023-02-19 20:00:24,865 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:24,865 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:24,865 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:24,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:24,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/hbase.id with ID: 8998fb7f-baf4-4482-8a8e-a97576ca4989 2023-02-19 20:00:24,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:24,888 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:24,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x51757d23 to 127.0.0.1:50355 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:24,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70fa0301, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:24,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:24,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:24,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:24,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store-tmp 2023-02-19 20:00:24,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:24,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:24,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:24,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:24,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:24,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:24,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:24,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:24,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/WALs/jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:24,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38635%2C1676836824781, suffix=, logDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/WALs/jenkins-hbase4.apache.org,38635,1676836824781, archiveDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:24,950 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK] 2023-02-19 20:00:24,951 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK] 2023-02-19 20:00:24,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/WALs/jenkins-hbase4.apache.org,38635,1676836824781/jenkins-hbase4.apache.org%2C38635%2C1676836824781.1676836824930 2023-02-19 20:00:24,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK], DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK]] 2023-02-19 20:00:24,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:24,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:24,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:24,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:24,956 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:24,957 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:24,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:24,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:24,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:24,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:24,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:24,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:24,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64653367, jitterRate=-0.03658975660800934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:24,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:24,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:24,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:24,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:24,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:24,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 20:00:24,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 20:00:24,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:24,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:24,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:24,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:24,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:24,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:24,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:24,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:24,990 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:24,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:24,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:24,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:24,993 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:24,993 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:24,993 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:24,993 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:24,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38635,1676836824781, sessionid=0x1006e2b50810000, setting cluster-up flag (Was=false) 2023-02-19 20:00:24,998 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:25,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:25,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:25,006 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:25,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:25,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:25,010 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.hbase-snapshot/.tmp 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:25,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836855014 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:25,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:25,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,015 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:25,015 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:25,016 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:25,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:25,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:25,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:25,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:25,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:25,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836825018,5,FailOnTimeoutGroup] 2023-02-19 20:00:25,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836825019,5,FailOnTimeoutGroup] 2023-02-19 20:00:25,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:25,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,025 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:25,026 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:25,026 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4 2023-02-19 20:00:25,034 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:25,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:25,036 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/info 2023-02-19 20:00:25,036 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:25,036 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,037 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:25,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:25,038 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:25,038 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,038 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:25,039 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/table 2023-02-19 20:00:25,039 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:25,040 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,040 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740 2023-02-19 20:00:25,041 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740 2023-02-19 20:00:25,042 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:25,043 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:25,045 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:25,045 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73484866, jitterRate=0.09500983357429504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:25,045 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:25,045 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:25,045 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:25,045 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:25,045 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:25,045 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:25,046 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:25,046 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:25,047 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:25,047 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:25,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:25,049 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:25,050 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:25,058 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(952): ClusterId : 8998fb7f-baf4-4482-8a8e-a97576ca4989 2023-02-19 20:00:25,058 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(952): ClusterId : 8998fb7f-baf4-4482-8a8e-a97576ca4989 2023-02-19 20:00:25,058 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:25,059 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:25,061 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:25,061 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:25,062 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:25,062 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:25,063 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:25,064 DEBUG [RS:0;jenkins-hbase4:42365] zookeeper.ReadOnlyZKClient(139): Connect 0x01efb9a7 to 127.0.0.1:50355 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:25,064 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:25,065 DEBUG [RS:1;jenkins-hbase4:37839] zookeeper.ReadOnlyZKClient(139): Connect 0x4545c118 to 127.0.0.1:50355 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:25,071 DEBUG [RS:0;jenkins-hbase4:42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f2847ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:25,071 DEBUG [RS:1;jenkins-hbase4:37839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b8227c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:25,071 DEBUG [RS:0;jenkins-hbase4:42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b17d2d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:25,071 DEBUG [RS:1;jenkins-hbase4:37839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fbdaa68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:25,080 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42365 2023-02-19 20:00:25,080 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37839 2023-02-19 20:00:25,080 INFO [RS:0;jenkins-hbase4:42365] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:25,080 INFO [RS:1;jenkins-hbase4:37839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:25,080 INFO [RS:1;jenkins-hbase4:37839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:25,080 INFO [RS:0;jenkins-hbase4:42365] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:25,080 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:25,080 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:25,081 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38635,1676836824781 with isa=jenkins-hbase4.apache.org/172.31.14.131:42365, startcode=1676836824819 2023-02-19 20:00:25,081 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38635,1676836824781 with isa=jenkins-hbase4.apache.org/172.31.14.131:37839, startcode=1676836824841 2023-02-19 20:00:25,081 DEBUG [RS:1;jenkins-hbase4:37839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:25,081 DEBUG [RS:0;jenkins-hbase4:42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:25,083 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45553, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:25,083 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56891, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:25,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38635] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,085 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4 2023-02-19 20:00:25,085 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4 2023-02-19 20:00:25,086 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41191 2023-02-19 20:00:25,086 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41191 2023-02-19 20:00:25,086 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:25,086 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:25,087 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:25,090 DEBUG [RS:0;jenkins-hbase4:42365] zookeeper.ZKUtil(162): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,091 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37839,1676836824841] 2023-02-19 20:00:25,091 WARN [RS:0;jenkins-hbase4:42365] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:25,091 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42365,1676836824819] 2023-02-19 20:00:25,091 DEBUG [RS:1;jenkins-hbase4:37839] zookeeper.ZKUtil(162): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,091 INFO [RS:0;jenkins-hbase4:42365] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:25,091 WARN [RS:1;jenkins-hbase4:37839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:25,091 INFO [RS:1;jenkins-hbase4:37839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:25,091 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,091 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,096 DEBUG [RS:0;jenkins-hbase4:42365] zookeeper.ZKUtil(162): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,096 DEBUG [RS:1;jenkins-hbase4:37839] zookeeper.ZKUtil(162): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,096 DEBUG [RS:0;jenkins-hbase4:42365] zookeeper.ZKUtil(162): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,096 DEBUG [RS:1;jenkins-hbase4:37839] zookeeper.ZKUtil(162): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,097 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:25,097 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:25,097 INFO [RS:0;jenkins-hbase4:42365] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:25,097 INFO [RS:1;jenkins-hbase4:37839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:25,099 INFO [RS:0;jenkins-hbase4:42365] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:25,099 INFO [RS:0;jenkins-hbase4:42365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:25,099 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,099 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:25,100 INFO [RS:1;jenkins-hbase4:37839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:25,100 INFO [RS:1;jenkins-hbase4:37839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:25,100 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,101 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,101 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,101 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,101 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:25,101 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,101 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,101 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,102 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:25,102 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,102 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,102 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,102 DEBUG [RS:0;jenkins-hbase4:42365] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,102 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,102 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,103 DEBUG [RS:1;jenkins-hbase4:37839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:25,104 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,104 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,104 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,114 INFO [RS:0;jenkins-hbase4:42365] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:25,114 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42365,1676836824819-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,115 INFO [RS:1;jenkins-hbase4:37839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:25,115 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37839,1676836824841-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,125 INFO [RS:1;jenkins-hbase4:37839] regionserver.Replication(203): jenkins-hbase4.apache.org,37839,1676836824841 started 2023-02-19 20:00:25,126 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37839,1676836824841, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37839, sessionid=0x1006e2b50810002 2023-02-19 20:00:25,126 INFO [RS:0;jenkins-hbase4:42365] regionserver.Replication(203): jenkins-hbase4.apache.org,42365,1676836824819 started 2023-02-19 20:00:25,126 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:25,126 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42365,1676836824819, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42365, sessionid=0x1006e2b50810001 2023-02-19 20:00:25,126 DEBUG [RS:1;jenkins-hbase4:37839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,126 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:25,126 DEBUG [RS:1;jenkins-hbase4:37839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37839,1676836824841' 2023-02-19 20:00:25,126 DEBUG [RS:1;jenkins-hbase4:37839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:25,126 DEBUG [RS:0;jenkins-hbase4:42365] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,126 DEBUG [RS:0;jenkins-hbase4:42365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42365,1676836824819' 2023-02-19 20:00:25,126 DEBUG [RS:0;jenkins-hbase4:42365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:25,126 DEBUG [RS:1;jenkins-hbase4:37839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:25,126 DEBUG [RS:0;jenkins-hbase4:42365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:25,127 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:25,127 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:25,127 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:25,127 DEBUG [RS:0;jenkins-hbase4:42365] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,127 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:25,127 DEBUG [RS:0;jenkins-hbase4:42365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42365,1676836824819' 2023-02-19 20:00:25,127 DEBUG [RS:0;jenkins-hbase4:42365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:25,127 DEBUG [RS:1;jenkins-hbase4:37839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,127 DEBUG [RS:1;jenkins-hbase4:37839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37839,1676836824841' 2023-02-19 20:00:25,127 DEBUG [RS:1;jenkins-hbase4:37839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:25,127 DEBUG [RS:0;jenkins-hbase4:42365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:25,127 DEBUG [RS:1;jenkins-hbase4:37839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:25,128 DEBUG [RS:1;jenkins-hbase4:37839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:25,128 INFO [RS:1;jenkins-hbase4:37839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:25,128 INFO [RS:1;jenkins-hbase4:37839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:25,128 DEBUG [RS:0;jenkins-hbase4:42365] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:25,128 INFO [RS:0;jenkins-hbase4:42365] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:25,128 INFO [RS:0;jenkins-hbase4:42365] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:25,200 DEBUG [jenkins-hbase4:38635] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:25,201 DEBUG [jenkins-hbase4:38635] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:25,202 DEBUG [jenkins-hbase4:38635] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:25,202 DEBUG [jenkins-hbase4:38635] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:25,202 DEBUG [jenkins-hbase4:38635] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:25,203 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42365,1676836824819, state=OPENING 2023-02-19 20:00:25,204 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:25,206 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:25,206 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:25,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42365,1676836824819}] 2023-02-19 20:00:25,361 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:25,361 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:25,363 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:25,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:25,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:25,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42365%2C1676836824819.meta, suffix=.meta, logDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,42365,1676836824819, archiveDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/oldWALs, maxLogs=32 2023-02-19 20:00:25,384 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK] 2023-02-19 20:00:25,384 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK] 2023-02-19 20:00:25,385 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,42365,1676836824819/jenkins-hbase4.apache.org%2C42365%2C1676836824819.meta.1676836825370.meta 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK], DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK]] 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:25,386 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:25,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:25,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:25,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/info 2023-02-19 20:00:25,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/info 2023-02-19 20:00:25,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:25,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,389 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:25,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:25,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:25,391 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:25,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:25,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/table 2023-02-19 20:00:25,392 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/table 2023-02-19 20:00:25,392 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:25,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740 2023-02-19 20:00:25,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740 2023-02-19 20:00:25,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:25,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:25,397 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74010553, jitterRate=0.10284318029880524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:25,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:25,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836825361 2023-02-19 20:00:25,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:25,402 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:25,403 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42365,1676836824819, state=OPEN 2023-02-19 20:00:25,404 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:25,404 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:25,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:25,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42365,1676836824819 in 198 msec 2023-02-19 20:00:25,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:25,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-19 20:00:25,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-19 20:00:25,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836825411, completionTime=-1 2023-02-19 20:00:25,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:25,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:25,414 DEBUG [hconnection-0x22ee9a23-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:25,416 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:25,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:25,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836885418 2023-02-19 20:00:25,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836945418 2023-02-19 20:00:25,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38635,1676836824781-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38635,1676836824781-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38635,1676836824781-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38635, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:25,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:25,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:25,429 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:25,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:25,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:25,432 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,432 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc empty. 2023-02-19 20:00:25,433 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,433 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:25,442 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:25,443 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7eb10f2703ee77b3e51961e3a97874cc, NAME => 'hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp 2023-02-19 20:00:25,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:25,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7eb10f2703ee77b3e51961e3a97874cc, disabling compactions & flushes 2023-02-19 20:00:25,450 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. after waiting 0 ms 2023-02-19 20:00:25,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,450 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,450 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7eb10f2703ee77b3e51961e3a97874cc: 2023-02-19 20:00:25,453 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:25,454 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836825454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836825454"}]},"ts":"1676836825454"} 2023-02-19 20:00:25,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:25,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:25,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836825458"}]},"ts":"1676836825458"} 2023-02-19 20:00:25,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:25,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:25,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:25,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:25,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:25,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7eb10f2703ee77b3e51961e3a97874cc, ASSIGN}] 2023-02-19 20:00:25,464 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7eb10f2703ee77b3e51961e3a97874cc, ASSIGN 2023-02-19 20:00:25,465 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7eb10f2703ee77b3e51961e3a97874cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37839,1676836824841; forceNewPlan=false, retain=false 2023-02-19 20:00:25,615 INFO [jenkins-hbase4:38635] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:25,617 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7eb10f2703ee77b3e51961e3a97874cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836825616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836825616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836825616"}]},"ts":"1676836825616"} 2023-02-19 20:00:25,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7eb10f2703ee77b3e51961e3a97874cc, server=jenkins-hbase4.apache.org,37839,1676836824841}] 2023-02-19 20:00:25,804 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,805 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:25,806 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:25,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37839%2C1676836824841, suffix=, logDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,37839,1676836824841, archiveDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/oldWALs, maxLogs=32 2023-02-19 20:00:25,831 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK] 2023-02-19 20:00:25,832 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK] 2023-02-19 20:00:25,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,37839,1676836824841/jenkins-hbase4.apache.org%2C37839%2C1676836824841.1676836825815 2023-02-19 20:00:25,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK], DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK]] 2023-02-19 20:00:25,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7eb10f2703ee77b3e51961e3a97874cc, NAME => 'hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:25,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:25,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,837 INFO [StoreOpener-7eb10f2703ee77b3e51961e3a97874cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,838 DEBUG [StoreOpener-7eb10f2703ee77b3e51961e3a97874cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/info 2023-02-19 20:00:25,838 DEBUG [StoreOpener-7eb10f2703ee77b3e51961e3a97874cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/info 2023-02-19 20:00:25,838 INFO [StoreOpener-7eb10f2703ee77b3e51961e3a97874cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eb10f2703ee77b3e51961e3a97874cc columnFamilyName info 2023-02-19 20:00:25,839 INFO [StoreOpener-7eb10f2703ee77b3e51961e3a97874cc-1] regionserver.HStore(310): Store=7eb10f2703ee77b3e51961e3a97874cc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:25,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:25,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:25,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7eb10f2703ee77b3e51961e3a97874cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70763670, jitterRate=0.05446085333824158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:25,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7eb10f2703ee77b3e51961e3a97874cc: 2023-02-19 20:00:25,847 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc., pid=6, masterSystemTime=1676836825804 2023-02-19 20:00:25,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,851 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:25,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7eb10f2703ee77b3e51961e3a97874cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:25,852 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836825852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836825852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836825852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836825852"}]},"ts":"1676836825852"} 2023-02-19 20:00:25,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:25,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7eb10f2703ee77b3e51961e3a97874cc, server=jenkins-hbase4.apache.org,37839,1676836824841 in 235 msec 2023-02-19 20:00:25,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:25,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7eb10f2703ee77b3e51961e3a97874cc, ASSIGN in 393 msec 2023-02-19 20:00:25,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:25,858 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836825858"}]},"ts":"1676836825858"} 2023-02-19 20:00:25,860 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:25,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:25,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 436 msec 2023-02-19 20:00:25,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:25,955 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:25,955 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:25,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:25,960 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:25,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:25,974 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:25,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-19 20:00:25,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:25,993 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:25,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-19 20:00:26,008 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:26,011 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:26,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.146sec 2023-02-19 20:00:26,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:26,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:26,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:26,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38635,1676836824781-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:26,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38635,1676836824781-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:26,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:26,059 DEBUG [Listener at localhost/45401] zookeeper.ReadOnlyZKClient(139): Connect 0x777606c0 to 127.0.0.1:50355 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:26,065 DEBUG [Listener at localhost/45401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57f69a68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:26,066 DEBUG [hconnection-0x18ba616-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:26,068 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56422, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:26,070 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:26,070 DEBUG [Listener at localhost/45401] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:26,074 DEBUG [Listener at localhost/45401] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:26,076 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35002, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:26,076 INFO [Listener at localhost/45401] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:26,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:26,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:26,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:35002 deadline: 1676836886077, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:26,078 INFO [Listener at localhost/45401] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-19 20:00:26,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:26,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:26,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:26,084 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-19 20:00:26,085 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:26,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:26,086 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,087 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 empty. 2023-02-19 20:00:26,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,088 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-19 20:00:26,098 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:26,099 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => b7cf984fe4f2f847ce29b3dd66cdd838, NAME => 'testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp 2023-02-19 20:00:26,108 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:26,108 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing b7cf984fe4f2f847ce29b3dd66cdd838, disabling compactions & flushes 2023-02-19 20:00:26,108 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,108 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,108 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. after waiting 0 ms 2023-02-19 20:00:26,108 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,109 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,109 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for b7cf984fe4f2f847ce29b3dd66cdd838: 2023-02-19 20:00:26,110 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:26,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676836826111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836826111"}]},"ts":"1676836826111"} 2023-02-19 20:00:26,113 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:26,114 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:26,114 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836826114"}]},"ts":"1676836826114"} 2023-02-19 20:00:26,115 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-19 20:00:26,119 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:26,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:26,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:26,120 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:26,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, ASSIGN}] 2023-02-19 20:00:26,122 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, ASSIGN 2023-02-19 20:00:26,123 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37839,1676836824841; forceNewPlan=false, retain=false 2023-02-19 20:00:26,130 INFO [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42365%2C1676836824819, suffix=, logDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,42365,1676836824819, archiveDir=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/oldWALs, maxLogs=32 2023-02-19 20:00:26,144 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK] 2023-02-19 20:00:26,144 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK] 2023-02-19 20:00:26,146 INFO [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,42365,1676836824819/jenkins-hbase4.apache.org%2C42365%2C1676836824819.1676836826130 2023-02-19 20:00:26,146 DEBUG [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40561,DS-1bd6ea4d-bba2-4c0c-b1d7-da83e3a4ec4a,DISK], DatanodeInfoWithStorage[127.0.0.1:46575,DS-001fd4d0-baa0-4fce-b0dc-2cdb820d97c4,DISK]] 2023-02-19 20:00:26,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:26,273 INFO [jenkins-hbase4:38635] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:26,275 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b7cf984fe4f2f847ce29b3dd66cdd838, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,275 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676836826275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836826275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836826275"}]},"ts":"1676836826275"} 2023-02-19 20:00:26,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b7cf984fe4f2f847ce29b3dd66cdd838, server=jenkins-hbase4.apache.org,37839,1676836824841}] 2023-02-19 20:00:26,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:26,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b7cf984fe4f2f847ce29b3dd66cdd838, NAME => 'testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:26,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:26,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,433 INFO [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,434 DEBUG [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1 2023-02-19 20:00:26,434 DEBUG [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1 2023-02-19 20:00:26,435 INFO [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7cf984fe4f2f847ce29b3dd66cdd838 columnFamilyName f1 2023-02-19 20:00:26,435 INFO [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] regionserver.HStore(310): Store=b7cf984fe4f2f847ce29b3dd66cdd838/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:26,435 INFO [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,437 DEBUG [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2 2023-02-19 20:00:26,437 DEBUG [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2 2023-02-19 20:00:26,437 INFO [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7cf984fe4f2f847ce29b3dd66cdd838 columnFamilyName f2 2023-02-19 20:00:26,437 INFO [StoreOpener-b7cf984fe4f2f847ce29b3dd66cdd838-1] regionserver.HStore(310): Store=b7cf984fe4f2f847ce29b3dd66cdd838/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:26,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:26,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:26,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:26,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b7cf984fe4f2f847ce29b3dd66cdd838; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64521100, jitterRate=-0.038560688495635986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:26,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b7cf984fe4f2f847ce29b3dd66cdd838: 2023-02-19 20:00:26,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838., pid=12, masterSystemTime=1676836826428 2023-02-19 20:00:26,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,457 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b7cf984fe4f2f847ce29b3dd66cdd838, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,457 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676836826457"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836826457"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836826457"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836826457"}]},"ts":"1676836826457"} 2023-02-19 20:00:26,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 20:00:26,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b7cf984fe4f2f847ce29b3dd66cdd838, server=jenkins-hbase4.apache.org,37839,1676836824841 in 183 msec 2023-02-19 20:00:26,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 20:00:26,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, ASSIGN in 341 msec 2023-02-19 20:00:26,465 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:26,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836826465"}]},"ts":"1676836826465"} 2023-02-19 20:00:26,466 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-19 20:00:26,488 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:26,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 407 msec 2023-02-19 20:00:26,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:26,691 INFO [Listener at localhost/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-19 20:00:26,691 DEBUG [Listener at localhost/45401] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-19 20:00:26,691 INFO [Listener at localhost/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:26,695 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-19 20:00:26,695 INFO [Listener at localhost/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:26,695 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-19 20:00:26,695 INFO [Listener at localhost/45401] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:26,721 DEBUG [hconnection-0x18ba616-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:26,742 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33788, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:26,751 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37839] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,868 INFO [Listener at localhost/45401] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:26,868 INFO [Listener at localhost/45401] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:26,869 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 20:00:26,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836826869 (current time:1676836826869). 2023-02-19 20:00:26,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:26,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] zookeeper.ReadOnlyZKClient(139): Connect 0x3d20367e to 127.0.0.1:50355 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:26,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@514f46c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:26,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:26,877 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56438, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d20367e to 127.0.0.1:50355 2023-02-19 20:00:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:26,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:26,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 20:00:26,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 20:00:26,881 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 20:00:26,882 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676837426882 2023-02-19 20:00:26,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 20:00:26,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:26,883 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:26,884 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 20:00:26,884 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:26,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 20:00:26,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-19 20:00:26,886 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 20:00:26,886 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676837426886 2023-02-19 20:00:26,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-19 20:00:26,900 INFO [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-19 20:00:26,900 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:26,901 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-19 20:00:26,901 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-19 20:00:26,901 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 20:00:26,901 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:26,903 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:26,903 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:26,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:26,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:26,903 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 20:00:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 20:00:26,904 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,904 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-19 20:00:26,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-19 20:00:26,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 20:00:26,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 20:00:26,908 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 20:00:26,908 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:26,909 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 20:00:26,909 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 20:00:26,909 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42365,1676836824819' joining acquired barrier for procedure (foo) in zk 2023-02-19 20:00:26,909 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 20:00:26,909 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:26,910 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 20:00:26,910 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 20:00:26,910 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37839,1676836824841' joining acquired barrier for procedure (foo) in zk 2023-02-19 20:00:26,912 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,913 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,913 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:26,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:26,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37839,1676836824841' joining acquired barrier for procedure 'foo' on coordinator 2023-02-19 20:00:26,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15d7bfb6[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:26,915 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-19 20:00:26,915 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 20:00:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 20:00:26,917 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,917 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 20:00:26,917 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42365,1676836824819' in zk 2023-02-19 20:00:26,919 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 20:00:26,919 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:26,919 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 20:00:26,923 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 20:00:26,923 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,923 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:26,923 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. started... 2023-02-19 20:00:26,924 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b7cf984fe4f2f847ce29b3dd66cdd838 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 20:00:26,945 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f1/7be18119daa749d38828ef84a5572eea 2023-02-19 20:00:26,971 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f2/6b14873aed8847ba98aa4001507efb5a 2023-02-19 20:00:26,976 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f1/7be18119daa749d38828ef84a5572eea as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/7be18119daa749d38828ef84a5572eea 2023-02-19 20:00:26,981 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/7be18119daa749d38828ef84a5572eea, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:26,982 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f2/6b14873aed8847ba98aa4001507efb5a as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/6b14873aed8847ba98aa4001507efb5a 2023-02-19 20:00:26,984 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:26,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-19 20:00:26,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:26,986 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:26,986 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/6b14873aed8847ba98aa4001507efb5a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:26,987 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b7cf984fe4f2f847ce29b3dd66cdd838 in 63ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:26,987 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b7cf984fe4f2f847ce29b3dd66cdd838: 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.' region-info for snapshot=foo 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/7be18119daa749d38828ef84a5572eea] hfiles 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/7be18119daa749d38828ef84a5572eea for snapshot=foo 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/6b14873aed8847ba98aa4001507efb5a] hfiles 2023-02-19 20:00:26,988 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/6b14873aed8847ba98aa4001507efb5a for snapshot=foo 2023-02-19 20:00:26,995 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. completed. 2023-02-19 20:00:26,996 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:26,996 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 20:00:26,996 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 20:00:26,996 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,996 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 20:00:26,996 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,37839,1676836824841' in zk 2023-02-19 20:00:26,998 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,998 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 20:00:26,998 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:26,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:26,998 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 20:00:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,37839,1676836824841': 2023-02-19 20:00:27,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37839,1676836824841' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-19 20:00:27,002 INFO [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-19 20:00:27,002 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:27,002 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:27,003 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-19 20:00:27,003 INFO [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:27,004 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:27,004 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:27,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,008 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:27,008 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:27,010 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:27,010 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:27,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:27,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-19 20:00:27,016 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:27,015 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,015 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:27,016 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:27,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:27,016 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,017 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:27,017 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:27,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:27,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.hbase-snapshot/.tmp/foo 2023-02-19 20:00:27,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:27,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.hbase-snapshot/.tmp/foo to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.hbase-snapshot/foo 2023-02-19 20:00:27,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-19 20:00:27,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.hbase-snapshot/.tmp/foo 2023-02-19 20:00:27,048 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.hbase-snapshot/.tmp/foo 2023-02-19 20:00:27,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676836826882Consolidate snapshot: foo at 1676836827016 (+134 ms)Loading Region manifests for foo at 1676836827016Writing data manifest for foo at 1676836827019 (+3 ms)Verifying snapshot: foo at 1676836827027 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676836827048 (+21 ms) 2023-02-19 20:00:27,050 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 20:00:27,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 167 msec 2023-02-19 20:00:27,186 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-19 20:00:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:27,189 INFO [Listener at localhost/45401] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:27,200 INFO [Listener at localhost/45401] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:27,206 INFO [Listener at localhost/45401] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:27,260 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37839] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,384 INFO [Listener at localhost/45401] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:27,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:27,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,392 INFO [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-19 20:00:27,392 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:27,392 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-19 20:00:27,392 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-19 20:00:27,393 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,393 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,396 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,396 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:27,396 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:27,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:27,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:27,396 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,396 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,398 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-19 20:00:27,398 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-19 20:00:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-19 20:00:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42365,1676836824819' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-19 20:00:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-19 20:00:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-19 20:00:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 20:00:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:27,401 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,401 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. started... 2023-02-19 20:00:27,401 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b7cf984fe4f2f847ce29b3dd66cdd838 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 20:00:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:27,420 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f1/0860bfe2ba1e414bb1eaf0b45ad4fa36 2023-02-19 20:00:27,440 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f2/e4005e8c8afb46a99475adc26ba9e2bd 2023-02-19 20:00:27,444 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f1/0860bfe2ba1e414bb1eaf0b45ad4fa36 as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/0860bfe2ba1e414bb1eaf0b45ad4fa36 2023-02-19 20:00:27,448 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/0860bfe2ba1e414bb1eaf0b45ad4fa36, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:27,449 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/.tmp/f2/e4005e8c8afb46a99475adc26ba9e2bd as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/e4005e8c8afb46a99475adc26ba9e2bd 2023-02-19 20:00:27,453 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/e4005e8c8afb46a99475adc26ba9e2bd, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:27,454 INFO [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b7cf984fe4f2f847ce29b3dd66cdd838 in 53ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:27,455 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b7cf984fe4f2f847ce29b3dd66cdd838: 2023-02-19 20:00:27,455 DEBUG [rs(jenkins-hbase4.apache.org,37839,1676836824841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 20:00:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 20:00:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-19 20:00:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37839,1676836824841' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-19 20:00:27,456 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,456 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:27,457 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,457 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:27,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37839,1676836824841' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-19 20:00:27,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11e839d4[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:27,458 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-19 20:00:27,458 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,459 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-19 20:00:27,459 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-19 20:00:27,459 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-19 20:00:27,459 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-19 20:00:27,459 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,37839,1676836824841' in zk 2023-02-19 20:00:27,459 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,42365,1676836824819' in zk 2023-02-19 20:00:27,459 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,460 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:27,462 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-19 20:00:27,462 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-19 20:00:27,462 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:27,462 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:27,462 DEBUG [member: 'jenkins-hbase4.apache.org,37839,1676836824841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-19 20:00:27,463 DEBUG [member: 'jenkins-hbase4.apache.org,42365,1676836824819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-19 20:00:27,462 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:27,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:27,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,37839,1676836824841': 2023-02-19 20:00:27,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37839,1676836824841' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-19 20:00:27,468 INFO [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-19 20:00:27,468 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:27,468 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:27,468 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,468 INFO [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:27,469 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,469 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:27,469 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,470 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,470 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:27,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:27,470 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:27,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:27,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,471 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,472 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:27,472 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:27,475 DEBUG [(jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:27,475 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-19 20:00:27,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:27,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:27,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:27,475 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:27,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:27,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:27,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:27,476 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,576 DEBUG [Listener at localhost/45401] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:27,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:27,582 INFO [Listener at localhost/45401] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676836826869 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:27,582 DEBUG [Listener at localhost/45401] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41191/user/jenkins/test-data/8890f88a-2951-e3a1-5542-fb30a3041289/foo/800e9e3a-43fc-4d28-ba73-fc36cd8f2fcc/data/default/testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,583 INFO [Listener at localhost/45401] snapshot.RestoreSnapshotHelper(239): region to add: b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:27,583 INFO [Listener at localhost/45401] snapshot.RestoreSnapshotHelper(585): clone region=b7cf984fe4f2f847ce29b3dd66cdd838 as b7cf984fe4f2f847ce29b3dd66cdd838 in snapshot foo 2023-02-19 20:00:27,583 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b7cf984fe4f2f847ce29b3dd66cdd838, NAME => 'testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41191/user/jenkins/test-data/8890f88a-2951-e3a1-5542-fb30a3041289/foo/800e9e3a-43fc-4d28-ba73-fc36cd8f2fcc 2023-02-19 20:00:27,590 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:27,590 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7be18119daa749d38828ef84a5572eea from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,592 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6b14873aed8847ba98aa4001507efb5a from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b7cf984fe4f2f847ce29b3dd66cdd838, disabling compactions & flushes 2023-02-19 20:00:27,594 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. after waiting 0 ms 2023-02-19 20:00:27,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,594 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,594 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b7cf984fe4f2f847ce29b3dd66cdd838: 2023-02-19 20:00:27,594 INFO [Listener at localhost/45401] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676836826869 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:27,594 DEBUG [Listener at localhost/45401] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41191/user/jenkins/test-data/8890f88a-2951-e3a1-5542-fb30a3041289/foo/800e9e3a-43fc-4d28-ba73-fc36cd8f2fcc 2023-02-19 20:00:27,594 DEBUG [Listener at localhost/45401] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41191/user/jenkins/test-data/8890f88a-2951-e3a1-5542-fb30a3041289/foo/800e9e3a-43fc-4d28-ba73-fc36cd8f2fcc 2023-02-19 20:00:27,595 DEBUG [Listener at localhost/45401] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:27,595 DEBUG [Listener at localhost/45401] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:27,596 DEBUG [Listener at localhost/45401] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-19 20:00:27,596 DEBUG [Listener at localhost/45401] util.CommonFSUtils(699): |----------b7cf984fe4f2f847ce29b3dd66cdd838/ 2023-02-19 20:00:27,597 DEBUG [Listener at localhost/45401] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:27,597 DEBUG [Listener at localhost/45401] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:27,597 DEBUG [Listener at localhost/45401] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=b7cf984fe4f2f847ce29b3dd66cdd838-7be18119daa749d38828ef84a5572eea 2023-02-19 20:00:27,598 DEBUG [Listener at localhost/45401] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:27,598 DEBUG [Listener at localhost/45401] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=b7cf984fe4f2f847ce29b3dd66cdd838-6b14873aed8847ba98aa4001507efb5a 2023-02-19 20:00:27,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-19 20:00:27,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-19 20:00:27,602 INFO [Listener at localhost/45401] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,606 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836827605"}]},"ts":"1676836827605"} 2023-02-19 20:00:27,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:27,607 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-19 20:00:27,608 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-19 20:00:27,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, UNASSIGN}] 2023-02-19 20:00:27,610 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, UNASSIGN 2023-02-19 20:00:27,611 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b7cf984fe4f2f847ce29b3dd66cdd838, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:27,611 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676836827611"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836827611"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836827611"}]},"ts":"1676836827611"} 2023-02-19 20:00:27,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b7cf984fe4f2f847ce29b3dd66cdd838, server=jenkins-hbase4.apache.org,37839,1676836824841}] 2023-02-19 20:00:27,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:27,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:27,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b7cf984fe4f2f847ce29b3dd66cdd838, disabling compactions & flushes 2023-02-19 20:00:27,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. after waiting 0 ms 2023-02-19 20:00:27,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:27,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838. 2023-02-19 20:00:27,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b7cf984fe4f2f847ce29b3dd66cdd838: 2023-02-19 20:00:27,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:27,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b7cf984fe4f2f847ce29b3dd66cdd838, regionState=CLOSED 2023-02-19 20:00:27,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676836827770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836827770"}]},"ts":"1676836827770"} 2023-02-19 20:00:27,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 20:00:27,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b7cf984fe4f2f847ce29b3dd66cdd838, server=jenkins-hbase4.apache.org,37839,1676836824841 in 160 msec 2023-02-19 20:00:27,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 20:00:27,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=b7cf984fe4f2f847ce29b3dd66cdd838, UNASSIGN in 164 msec 2023-02-19 20:00:27,775 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836827775"}]},"ts":"1676836827775"} 2023-02-19 20:00:27,776 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-19 20:00:27,779 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-19 20:00:27,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 176 msec 2023-02-19 20:00:27,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:27,909 INFO [Listener at localhost/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-19 20:00:27,910 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,912 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,913 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:27,916 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:27,918 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1, FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2, FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/recovered.edits] 2023-02-19 20:00:27,922 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/0860bfe2ba1e414bb1eaf0b45ad4fa36 to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/archive/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/0860bfe2ba1e414bb1eaf0b45ad4fa36 2023-02-19 20:00:27,923 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/7be18119daa749d38828ef84a5572eea to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/archive/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f1/7be18119daa749d38828ef84a5572eea 2023-02-19 20:00:27,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/6b14873aed8847ba98aa4001507efb5a to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/archive/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/6b14873aed8847ba98aa4001507efb5a 2023-02-19 20:00:27,926 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/e4005e8c8afb46a99475adc26ba9e2bd to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/archive/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/f2/e4005e8c8afb46a99475adc26ba9e2bd 2023-02-19 20:00:27,929 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/recovered.edits/12.seqid to hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/archive/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838/recovered.edits/12.seqid 2023-02-19 20:00:27,929 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/.tmp/data/default/testInitTableSnapshotMapperJobConfig/b7cf984fe4f2f847ce29b3dd66cdd838 2023-02-19 20:00:27,929 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-19 20:00:27,931 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,933 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-19 20:00:27,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-19 20:00:27,936 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,936 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-19 20:00:27,936 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836827936"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:27,937 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 20:00:27,937 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b7cf984fe4f2f847ce29b3dd66cdd838, NAME => 'testInitTableSnapshotMapperJobConfig,,1676836826080.b7cf984fe4f2f847ce29b3dd66cdd838.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 20:00:27,937 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-19 20:00:27,938 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676836827937"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:27,941 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-19 20:00:27,942 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 20:00:27,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-19 20:00:28,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38635] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:28,015 INFO [Listener at localhost/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-19 20:00:28,015 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:28,015 INFO [Listener at localhost/45401] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:28,015 DEBUG [Listener at localhost/45401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x777606c0 to 127.0.0.1:50355 2023-02-19 20:00:28,015 DEBUG [Listener at localhost/45401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,015 DEBUG [Listener at localhost/45401] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:28,015 DEBUG [Listener at localhost/45401] util.JVMClusterUtil(257): Found active master hash=1813498737, stopped=false 2023-02-19 20:00:28,016 INFO [Listener at localhost/45401] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:28,017 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:28,017 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:28,017 INFO [Listener at localhost/45401] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:28,017 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:28,017 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:28,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:28,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:28,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:28,019 DEBUG [Listener at localhost/45401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51757d23 to 127.0.0.1:50355 2023-02-19 20:00:28,019 DEBUG [Listener at localhost/45401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,020 INFO [Listener at localhost/45401] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42365,1676836824819' ***** 2023-02-19 20:00:28,020 INFO [Listener at localhost/45401] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:28,020 INFO [Listener at localhost/45401] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37839,1676836824841' ***** 2023-02-19 20:00:28,020 INFO [Listener at localhost/45401] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:28,020 INFO [RS:0;jenkins-hbase4:42365] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:28,020 INFO [RS:1;jenkins-hbase4:37839] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:28,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:28,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:28,020 INFO [RS:0;jenkins-hbase4:42365] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:28,020 INFO [RS:0;jenkins-hbase4:42365] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:28,020 INFO [RS:1;jenkins-hbase4:37839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:28,020 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:28,020 INFO [RS:1;jenkins-hbase4:37839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:28,021 DEBUG [RS:0;jenkins-hbase4:42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01efb9a7 to 127.0.0.1:50355 2023-02-19 20:00:28,021 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(3304): Received CLOSE for 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:28,021 DEBUG [RS:0;jenkins-hbase4:42365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,021 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:28,021 INFO [RS:0;jenkins-hbase4:42365] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:28,021 INFO [RS:0;jenkins-hbase4:42365] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:28,021 INFO [RS:0;jenkins-hbase4:42365] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:28,021 DEBUG [RS:1;jenkins-hbase4:37839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4545c118 to 127.0.0.1:50355 2023-02-19 20:00:28,021 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:28,021 DEBUG [RS:1;jenkins-hbase4:37839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,021 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 20:00:28,021 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1479): Online Regions={7eb10f2703ee77b3e51961e3a97874cc=hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc.} 2023-02-19 20:00:28,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7eb10f2703ee77b3e51961e3a97874cc, disabling compactions & flushes 2023-02-19 20:00:28,021 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 20:00:28,023 DEBUG [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1505): Waiting on 7eb10f2703ee77b3e51961e3a97874cc 2023-02-19 20:00:28,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:28,023 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. after waiting 0 ms 2023-02-19 20:00:28,023 DEBUG [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 20:00:28,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:28,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7eb10f2703ee77b3e51961e3a97874cc 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:28,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:28,023 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-19 20:00:28,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/.tmp/info/b881ed5b9d194f3486bc5bffd7e8f10c 2023-02-19 20:00:28,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/.tmp/info/379c5c9ae3b049548a561234c3dc5bf3 2023-02-19 20:00:28,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/.tmp/info/b881ed5b9d194f3486bc5bffd7e8f10c as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/info/b881ed5b9d194f3486bc5bffd7e8f10c 2023-02-19 20:00:28,044 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 379c5c9ae3b049548a561234c3dc5bf3 2023-02-19 20:00:28,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/info/b881ed5b9d194f3486bc5bffd7e8f10c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:28,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7eb10f2703ee77b3e51961e3a97874cc in 26ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:28,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 20:00:28,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/namespace/7eb10f2703ee77b3e51961e3a97874cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:28,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/.tmp/rep_barrier/7b7e8fa7c60c4685b69e06be8e791f10 2023-02-19 20:00:28,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:28,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7eb10f2703ee77b3e51961e3a97874cc: 2023-02-19 20:00:28,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836825427.7eb10f2703ee77b3e51961e3a97874cc. 2023-02-19 20:00:28,062 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b7e8fa7c60c4685b69e06be8e791f10 2023-02-19 20:00:28,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/.tmp/table/7b4298dbd1a14f7da11c573867c9cb12 2023-02-19 20:00:28,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b4298dbd1a14f7da11c573867c9cb12 2023-02-19 20:00:28,073 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/.tmp/info/379c5c9ae3b049548a561234c3dc5bf3 as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/info/379c5c9ae3b049548a561234c3dc5bf3 2023-02-19 20:00:28,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 379c5c9ae3b049548a561234c3dc5bf3 2023-02-19 20:00:28,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/info/379c5c9ae3b049548a561234c3dc5bf3, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 20:00:28,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/.tmp/rep_barrier/7b7e8fa7c60c4685b69e06be8e791f10 as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/rep_barrier/7b7e8fa7c60c4685b69e06be8e791f10 2023-02-19 20:00:28,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b7e8fa7c60c4685b69e06be8e791f10 2023-02-19 20:00:28,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/rep_barrier/7b7e8fa7c60c4685b69e06be8e791f10, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 20:00:28,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/.tmp/table/7b4298dbd1a14f7da11c573867c9cb12 as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/table/7b4298dbd1a14f7da11c573867c9cb12 2023-02-19 20:00:28,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b4298dbd1a14f7da11c573867c9cb12 2023-02-19 20:00:28,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/table/7b4298dbd1a14f7da11c573867c9cb12, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 20:00:28,087 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 64ms, sequenceid=21, compaction requested=false 2023-02-19 20:00:28,087 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 20:00:28,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 20:00:28,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:28,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:28,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:28,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:28,106 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:28,107 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:28,108 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 20:00:28,108 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 20:00:28,169 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 20:00:28,169 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 20:00:28,223 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37839,1676836824841; all regions closed. 2023-02-19 20:00:28,223 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42365,1676836824819; all regions closed. 2023-02-19 20:00:28,227 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/WALs/jenkins-hbase4.apache.org,42365,1676836824819/jenkins-hbase4.apache.org%2C42365%2C1676836824819.meta.1676836825370.meta not finished, retry = 0 2023-02-19 20:00:28,229 DEBUG [RS:1;jenkins-hbase4:37839] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/oldWALs 2023-02-19 20:00:28,229 INFO [RS:1;jenkins-hbase4:37839] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37839%2C1676836824841:(num 1676836825815) 2023-02-19 20:00:28,229 DEBUG [RS:1;jenkins-hbase4:37839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,229 INFO [RS:1;jenkins-hbase4:37839] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:28,229 INFO [RS:1;jenkins-hbase4:37839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:28,229 INFO [RS:1;jenkins-hbase4:37839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:28,229 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:28,229 INFO [RS:1;jenkins-hbase4:37839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:28,229 INFO [RS:1;jenkins-hbase4:37839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:28,230 INFO [RS:1;jenkins-hbase4:37839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37839 2023-02-19 20:00:28,231 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:28,231 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:28,231 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37839,1676836824841 2023-02-19 20:00:28,232 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67ceca4e rejected from java.util.concurrent.ThreadPoolExecutor@63f1426f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,232 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:28,232 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:28,232 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6125465 rejected from java.util.concurrent.ThreadPoolExecutor@63f1426f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,233 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37839,1676836824841] 2023-02-19 20:00:28,233 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37839,1676836824841; numProcessing=1 2023-02-19 20:00:28,235 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37839,1676836824841 already deleted, retry=false 2023-02-19 20:00:28,235 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37839,1676836824841 expired; onlineServers=1 2023-02-19 20:00:28,331 DEBUG [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/oldWALs 2023-02-19 20:00:28,331 INFO [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42365%2C1676836824819.meta:.meta(num 1676836825370) 2023-02-19 20:00:28,337 DEBUG [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/oldWALs 2023-02-19 20:00:28,337 INFO [RS:0;jenkins-hbase4:42365] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42365%2C1676836824819:(num 1676836826130) 2023-02-19 20:00:28,337 DEBUG [RS:0;jenkins-hbase4:42365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,337 INFO [RS:0;jenkins-hbase4:42365] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:28,337 INFO [RS:0;jenkins-hbase4:42365] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:28,337 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:28,338 INFO [RS:0;jenkins-hbase4:42365] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42365 2023-02-19 20:00:28,340 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:28,340 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42365,1676836824819 2023-02-19 20:00:28,340 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1155d1ff rejected from java.util.concurrent.ThreadPoolExecutor@156a570d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,341 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42365,1676836824819] 2023-02-19 20:00:28,341 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42365,1676836824819; numProcessing=2 2023-02-19 20:00:28,345 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42365,1676836824819 already deleted, retry=false 2023-02-19 20:00:28,345 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42365,1676836824819 expired; onlineServers=0 2023-02-19 20:00:28,345 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38635,1676836824781' ***** 2023-02-19 20:00:28,345 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:28,346 DEBUG [M:0;jenkins-hbase4:38635] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6828422b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:28,346 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38635,1676836824781 2023-02-19 20:00:28,346 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38635,1676836824781; all regions closed. 2023-02-19 20:00:28,346 DEBUG [M:0;jenkins-hbase4:38635] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:28,346 DEBUG [M:0;jenkins-hbase4:38635] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:28,346 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:28,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836825019] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836825019,5,FailOnTimeoutGroup] 2023-02-19 20:00:28,346 DEBUG [M:0;jenkins-hbase4:38635] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:28,347 INFO [M:0;jenkins-hbase4:38635] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:28,347 INFO [M:0;jenkins-hbase4:38635] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:28,347 INFO [M:0;jenkins-hbase4:38635] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:28,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836825018] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836825018,5,FailOnTimeoutGroup] 2023-02-19 20:00:28,348 DEBUG [M:0;jenkins-hbase4:38635] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:28,348 INFO [M:0;jenkins-hbase4:38635] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:28,349 ERROR [M:0;jenkins-hbase4:38635] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 20:00:28,349 INFO [M:0;jenkins-hbase4:38635] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:28,349 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:28,349 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:28,349 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:28,349 DEBUG [M:0;jenkins-hbase4:38635] zookeeper.ZKUtil(398): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:28,349 WARN [M:0;jenkins-hbase4:38635] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:28,349 INFO [M:0;jenkins-hbase4:38635] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:28,350 INFO [M:0;jenkins-hbase4:38635] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:28,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:28,351 DEBUG [M:0;jenkins-hbase4:38635] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:28,351 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:28,351 DEBUG [M:0;jenkins-hbase4:38635] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:28,351 DEBUG [M:0;jenkins-hbase4:38635] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:28,351 DEBUG [M:0;jenkins-hbase4:38635] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:28,351 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-19 20:00:28,404 INFO [M:0;jenkins-hbase4:38635] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/df00ac75f08347d086c70c8302d4beda 2023-02-19 20:00:28,410 DEBUG [M:0;jenkins-hbase4:38635] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/df00ac75f08347d086c70c8302d4beda as hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/df00ac75f08347d086c70c8302d4beda 2023-02-19 20:00:28,414 INFO [M:0;jenkins-hbase4:38635] regionserver.HStore(1080): Added hdfs://localhost:41191/user/jenkins/test-data/6c35790c-16cc-d9c5-a0bb-f9cc87238af4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/df00ac75f08347d086c70c8302d4beda, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 20:00:28,415 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 64ms, sequenceid=132, compaction requested=false 2023-02-19 20:00:28,416 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:28,416 DEBUG [M:0;jenkins-hbase4:38635] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:28,420 INFO [M:0;jenkins-hbase4:38635] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:28,420 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:28,421 INFO [M:0;jenkins-hbase4:38635] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38635 2023-02-19 20:00:28,422 DEBUG [M:0;jenkins-hbase4:38635] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38635,1676836824781 already deleted, retry=false 2023-02-19 20:00:28,519 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:28,519 INFO [RS:0;jenkins-hbase4:42365] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42365,1676836824819; zookeeper connection closed. 2023-02-19 20:00:28,519 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e177460 rejected from java.util.concurrent.ThreadPoolExecutor@156a570d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,519 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:42365-0x1006e2b50810001, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:28,519 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@478c636c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@478c636c 2023-02-19 20:00:28,519 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26e77d68 rejected from java.util.concurrent.ThreadPoolExecutor@156a570d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,619 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:28,619 INFO [RS:1;jenkins-hbase4:37839] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37839,1676836824841; zookeeper connection closed. 2023-02-19 20:00:28,619 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e94a8f5 rejected from java.util.concurrent.ThreadPoolExecutor@63f1426f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,619 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): regionserver:37839-0x1006e2b50810002, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:28,619 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5279eaf8 rejected from java.util.concurrent.ThreadPoolExecutor@63f1426f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,619 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@21f2295b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@21f2295b 2023-02-19 20:00:28,620 INFO [Listener at localhost/45401] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:28,719 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:28,719 INFO [M:0;jenkins-hbase4:38635] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38635,1676836824781; zookeeper connection closed. 2023-02-19 20:00:28,719 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6413b731 rejected from java.util.concurrent.ThreadPoolExecutor@602c3f6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,720 DEBUG [Listener at localhost/45401-EventThread] zookeeper.ZKWatcher(600): master:38635-0x1006e2b50810000, quorum=127.0.0.1:50355, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:28,720 ERROR [Listener at localhost/45401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d124138 rejected from java.util.concurrent.ThreadPoolExecutor@602c3f6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:28,720 WARN [Listener at localhost/45401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:28,724 INFO [Listener at localhost/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:28,831 WARN [BP-70890021-172.31.14.131-1676836824197 heartbeating to localhost/127.0.0.1:41191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:28,831 WARN [BP-70890021-172.31.14.131-1676836824197 heartbeating to localhost/127.0.0.1:41191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-70890021-172.31.14.131-1676836824197 (Datanode Uuid ac6b4f0c-dec4-4a51-b297-8544327a0d67) service to localhost/127.0.0.1:41191 2023-02-19 20:00:28,833 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/dfs/data/data3/current/BP-70890021-172.31.14.131-1676836824197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:28,834 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/dfs/data/data4/current/BP-70890021-172.31.14.131-1676836824197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:28,835 WARN [Listener at localhost/45401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:28,842 INFO [Listener at localhost/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:28,946 WARN [BP-70890021-172.31.14.131-1676836824197 heartbeating to localhost/127.0.0.1:41191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:28,946 WARN [BP-70890021-172.31.14.131-1676836824197 heartbeating to localhost/127.0.0.1:41191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-70890021-172.31.14.131-1676836824197 (Datanode Uuid 3491d068-45a7-48b3-8184-9a1176de327f) service to localhost/127.0.0.1:41191 2023-02-19 20:00:28,947 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/dfs/data/data1/current/BP-70890021-172.31.14.131-1676836824197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:28,947 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/cluster_37bdcf2c-0f63-0602-245f-5ea8154fb325/dfs/data/data2/current/BP-70890021-172.31.14.131-1676836824197] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:28,957 INFO [Listener at localhost/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:29,070 INFO [Listener at localhost/45401] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:29,091 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:29,103 INFO [Listener at localhost/45401] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=181 (was 156) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:41191 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41191 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45401 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41191 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:41191 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41191 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41191 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:41191 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38635,1676836824781)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=567 (was 539) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=424 (was 434), ProcessCount=170 (was 170), AvailableMemoryMB=9203 (was 9286) 2023-02-19 20:00:29,112 INFO [Listener at localhost/45401] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=181, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=424, ProcessCount=170, AvailableMemoryMB=9203 2023-02-19 20:00:29,122 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/hadoop.log.dir so I do NOT create it in target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65 2023-02-19 20:00:29,122 WARN [Listener at localhost/45401] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 20:00:29,122 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/hadoop.tmp.dir so I do NOT create it in target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65 2023-02-19 20:00:29,122 WARN [Listener at localhost/45401] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/70658180-e98f-303c-fa97-9d6b845d609f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 20:00:29,123 DEBUG [Listener at localhost/45401] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15, deleteOnExit=true 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/test.cache.data in system properties and HBase conf 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:00:29,123 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:00:29,123 DEBUG [Listener at localhost/45401] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:29,124 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:00:29,125 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:00:29,125 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:00:29,125 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:29,125 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:00:29,125 INFO [Listener at localhost/45401] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:00:29,129 WARN [Listener at localhost/45401] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:29,129 WARN [Listener at localhost/45401] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:29,181 WARN [Listener at localhost/45401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:29,183 INFO [Listener at localhost/45401] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:29,197 INFO [Listener at localhost/45401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/java.io.tmpdir/Jetty_localhost_41453_hdfs____yzds67/webapp 2023-02-19 20:00:29,311 INFO [Listener at localhost/45401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41453 2023-02-19 20:00:29,316 WARN [Listener at localhost/45401] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:29,316 WARN [Listener at localhost/45401] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:29,334 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:29,353 WARN [Listener at localhost/37583] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:29,364 WARN [Listener at localhost/37583] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:29,366 WARN [Listener at localhost/37583] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:29,367 INFO [Listener at localhost/37583] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:29,373 INFO [Listener at localhost/37583] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/java.io.tmpdir/Jetty_localhost_37361_datanode____mgpjxt/webapp 2023-02-19 20:00:29,466 INFO [Listener at localhost/37583] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37361 2023-02-19 20:00:29,476 WARN [Listener at localhost/37499] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:29,500 WARN [Listener at localhost/37499] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:29,504 WARN [Listener at localhost/37499] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:29,505 INFO [Listener at localhost/37499] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:29,509 INFO [Listener at localhost/37499] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/java.io.tmpdir/Jetty_localhost_34051_datanode____.in37pq/webapp 2023-02-19 20:00:29,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x43d7ec664151a9ac: Processing first storage report for DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9 from datanode 49b5b41c-7698-4ca4-b03d-26700ee5816f 2023-02-19 20:00:29,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x43d7ec664151a9ac: from storage DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9 node DatanodeRegistration(127.0.0.1:46219, datanodeUuid=49b5b41c-7698-4ca4-b03d-26700ee5816f, infoPort=36083, infoSecurePort=0, ipcPort=37499, storageInfo=lv=-57;cid=testClusterID;nsid=979241589;c=1676836829131), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:29,571 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x43d7ec664151a9ac: Processing first storage report for DS-fccde1dc-62a1-4d8f-b758-c655946afc2b from datanode 49b5b41c-7698-4ca4-b03d-26700ee5816f 2023-02-19 20:00:29,571 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x43d7ec664151a9ac: from storage DS-fccde1dc-62a1-4d8f-b758-c655946afc2b node DatanodeRegistration(127.0.0.1:46219, datanodeUuid=49b5b41c-7698-4ca4-b03d-26700ee5816f, infoPort=36083, infoSecurePort=0, ipcPort=37499, storageInfo=lv=-57;cid=testClusterID;nsid=979241589;c=1676836829131), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:29,610 INFO [Listener at localhost/37499] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34051 2023-02-19 20:00:29,617 WARN [Listener at localhost/34071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:29,714 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbc5102ec72a009af: Processing first storage report for DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63 from datanode 98325058-b552-403b-be73-c6ba0bf964d2 2023-02-19 20:00:29,714 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbc5102ec72a009af: from storage DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63 node DatanodeRegistration(127.0.0.1:46365, datanodeUuid=98325058-b552-403b-be73-c6ba0bf964d2, infoPort=43675, infoSecurePort=0, ipcPort=34071, storageInfo=lv=-57;cid=testClusterID;nsid=979241589;c=1676836829131), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:29,714 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbc5102ec72a009af: Processing first storage report for DS-7a26ad9a-5984-4ff2-8dd7-c9ee783fbd3e from datanode 98325058-b552-403b-be73-c6ba0bf964d2 2023-02-19 20:00:29,714 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbc5102ec72a009af: from storage DS-7a26ad9a-5984-4ff2-8dd7-c9ee783fbd3e node DatanodeRegistration(127.0.0.1:46365, datanodeUuid=98325058-b552-403b-be73-c6ba0bf964d2, infoPort=43675, infoSecurePort=0, ipcPort=34071, storageInfo=lv=-57;cid=testClusterID;nsid=979241589;c=1676836829131), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:29,725 DEBUG [Listener at localhost/34071] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65 2023-02-19 20:00:29,727 INFO [Listener at localhost/34071] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/zookeeper_0, clientPort=64895, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:00:29,728 INFO [Listener at localhost/34071] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64895 2023-02-19 20:00:29,728 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,730 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,757 INFO [Listener at localhost/34071] util.FSUtils(479): Created version file at hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f with version=8 2023-02-19 20:00:29,758 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,759 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,760 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/hbase-staging 2023-02-19 20:00:29,761 INFO [Listener at localhost/34071] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:29,762 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,762 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,762 INFO [Listener at localhost/34071] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:29,762 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,762 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:29,762 INFO [Listener at localhost/34071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:29,768 INFO [Listener at localhost/34071] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34205 2023-02-19 20:00:29,768 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,769 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,770 INFO [Listener at localhost/34071] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34205 connecting to ZooKeeper ensemble=127.0.0.1:64895 2023-02-19 20:00:29,776 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:342050x0, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:29,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34205-0x1006e2b63e30000 connected 2023-02-19 20:00:29,790 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:29,790 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:29,790 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:29,791 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34205 2023-02-19 20:00:29,791 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34205 2023-02-19 20:00:29,791 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34205 2023-02-19 20:00:29,791 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34205 2023-02-19 20:00:29,792 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34205 2023-02-19 20:00:29,792 INFO [Listener at localhost/34071] master.HMaster(444): hbase.rootdir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f, hbase.cluster.distributed=false 2023-02-19 20:00:29,804 INFO [Listener at localhost/34071] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:29,804 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,805 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,805 INFO [Listener at localhost/34071] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:29,805 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,805 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:29,805 INFO [Listener at localhost/34071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:29,805 INFO [Listener at localhost/34071] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42789 2023-02-19 20:00:29,806 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:29,807 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:29,807 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,808 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,809 INFO [Listener at localhost/34071] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42789 connecting to ZooKeeper ensemble=127.0.0.1:64895 2023-02-19 20:00:29,812 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:427890x0, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:29,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42789-0x1006e2b63e30001 connected 2023-02-19 20:00:29,813 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:29,813 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:29,814 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:29,814 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42789 2023-02-19 20:00:29,816 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42789 2023-02-19 20:00:29,816 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42789 2023-02-19 20:00:29,816 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42789 2023-02-19 20:00:29,817 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42789 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:29,827 INFO [Listener at localhost/34071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:29,828 INFO [Listener at localhost/34071] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42493 2023-02-19 20:00:29,828 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:29,829 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:29,830 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,831 INFO [Listener at localhost/34071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,831 INFO [Listener at localhost/34071] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42493 connecting to ZooKeeper ensemble=127.0.0.1:64895 2023-02-19 20:00:29,835 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:424930x0, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:29,836 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): regionserver:424930x0, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:29,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42493-0x1006e2b63e30002 connected 2023-02-19 20:00:29,837 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:29,837 DEBUG [Listener at localhost/34071] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:29,838 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42493 2023-02-19 20:00:29,838 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42493 2023-02-19 20:00:29,838 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42493 2023-02-19 20:00:29,839 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42493 2023-02-19 20:00:29,839 DEBUG [Listener at localhost/34071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42493 2023-02-19 20:00:29,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:29,841 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:29,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:29,842 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:29,843 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:29,843 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:29,843 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:29,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:29,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34205,1676836829761 from backup master directory 2023-02-19 20:00:29,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:29,846 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:29,846 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:29,846 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:29,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:29,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/hbase.id with ID: 0e56d766-271f-48de-ae9e-f48aef5af199 2023-02-19 20:00:29,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:29,868 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:29,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x423dc86f to 127.0.0.1:64895 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:29,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62c39616, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:29,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:29,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:29,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:29,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store-tmp 2023-02-19 20:00:29,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:29,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:29,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:29,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:29,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:29,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:29,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:29,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:29,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/WALs/jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:29,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34205%2C1676836829761, suffix=, logDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/WALs/jenkins-hbase4.apache.org,34205,1676836829761, archiveDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:29,921 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK] 2023-02-19 20:00:29,922 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK] 2023-02-19 20:00:29,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/WALs/jenkins-hbase4.apache.org,34205,1676836829761/jenkins-hbase4.apache.org%2C34205%2C1676836829761.1676836829897 2023-02-19 20:00:29,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK], DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK]] 2023-02-19 20:00:29,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:29,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:29,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:29,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:29,939 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:29,940 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:29,941 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:29,941 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:29,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:29,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:29,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:29,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:29,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71030077, jitterRate=0.05843062698841095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:29,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:29,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:29,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:29,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:29,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:29,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 20:00:29,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 20:00:29,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:29,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:29,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:29,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:29,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:29,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:29,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:29,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:29,994 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:29,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:29,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:29,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:29,997 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:29,997 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:29,997 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:29,997 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:29,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34205,1676836829761, sessionid=0x1006e2b63e30000, setting cluster-up flag (Was=false) 2023-02-19 20:00:30,004 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:30,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:30,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:30,014 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:30,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:30,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:30,025 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.hbase-snapshot/.tmp 2023-02-19 20:00:30,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:30,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836860060 2023-02-19 20:00:30,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:30,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:30,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:30,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:30,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:30,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:30,062 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(952): ClusterId : 0e56d766-271f-48de-ae9e-f48aef5af199 2023-02-19 20:00:30,063 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:30,065 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:30,065 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:30,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,067 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:30,067 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:30,067 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:30,070 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:30,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:30,078 DEBUG [RS:0;jenkins-hbase4:42789] zookeeper.ReadOnlyZKClient(139): Connect 0x32533615 to 127.0.0.1:64895 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:30,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:30,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:30,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:30,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:30,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836830084,5,FailOnTimeoutGroup] 2023-02-19 20:00:30,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836830084,5,FailOnTimeoutGroup] 2023-02-19 20:00:30,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:30,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,098 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(952): ClusterId : 0e56d766-271f-48de-ae9e-f48aef5af199 2023-02-19 20:00:30,099 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:30,102 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:30,102 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:30,104 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:30,105 DEBUG [RS:0;jenkins-hbase4:42789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c94ce2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:30,106 DEBUG [RS:1;jenkins-hbase4:42493] zookeeper.ReadOnlyZKClient(139): Connect 0x7de674e9 to 127.0.0.1:64895 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:30,106 DEBUG [RS:0;jenkins-hbase4:42789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38ab5d65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:30,111 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:30,111 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:30,111 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f 2023-02-19 20:00:30,112 DEBUG [RS:1;jenkins-hbase4:42493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73219525, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:30,112 DEBUG [RS:1;jenkins-hbase4:42493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@771e1f99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:30,117 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42789 2023-02-19 20:00:30,117 INFO [RS:0;jenkins-hbase4:42789] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:30,117 INFO [RS:0;jenkins-hbase4:42789] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:30,117 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:30,118 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34205,1676836829761 with isa=jenkins-hbase4.apache.org/172.31.14.131:42789, startcode=1676836829804 2023-02-19 20:00:30,118 DEBUG [RS:0;jenkins-hbase4:42789] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:30,120 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53255, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:30,120 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42493 2023-02-19 20:00:30,121 INFO [RS:1;jenkins-hbase4:42493] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:30,121 INFO [RS:1;jenkins-hbase4:42493] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:30,121 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:30,121 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34205,1676836829761 with isa=jenkins-hbase4.apache.org/172.31.14.131:42493, startcode=1676836829827 2023-02-19 20:00:30,121 DEBUG [RS:1;jenkins-hbase4:42493] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:30,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,126 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f 2023-02-19 20:00:30,126 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53147, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:30,126 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37583 2023-02-19 20:00:30,127 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:30,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,128 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f 2023-02-19 20:00:30,128 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37583 2023-02-19 20:00:30,128 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:30,128 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:30,129 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:30,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:30,133 DEBUG [RS:0;jenkins-hbase4:42789] zookeeper.ZKUtil(162): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,133 WARN [RS:0;jenkins-hbase4:42789] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:30,133 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42493,1676836829827] 2023-02-19 20:00:30,133 INFO [RS:0;jenkins-hbase4:42789] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:30,133 DEBUG [RS:1;jenkins-hbase4:42493] zookeeper.ZKUtil(162): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,133 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42789,1676836829804] 2023-02-19 20:00:30,133 WARN [RS:1;jenkins-hbase4:42493] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:30,133 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,133 INFO [RS:1;jenkins-hbase4:42493] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:30,133 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/info 2023-02-19 20:00:30,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:30,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:30,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:30,140 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:30,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,141 DEBUG [RS:0;jenkins-hbase4:42789] zookeeper.ZKUtil(162): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:30,141 DEBUG [RS:1;jenkins-hbase4:42493] zookeeper.ZKUtil(162): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,142 DEBUG [RS:0;jenkins-hbase4:42789] zookeeper.ZKUtil(162): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,142 DEBUG [RS:1;jenkins-hbase4:42493] zookeeper.ZKUtil(162): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/table 2023-02-19 20:00:30,142 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:30,142 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:30,142 DEBUG [RS:1;jenkins-hbase4:42493] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:30,143 INFO [RS:0;jenkins-hbase4:42789] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:30,143 INFO [RS:1;jenkins-hbase4:42493] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:30,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,143 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740 2023-02-19 20:00:30,144 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740 2023-02-19 20:00:30,144 INFO [RS:0;jenkins-hbase4:42789] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:30,145 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:30,146 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:30,148 INFO [RS:0;jenkins-hbase4:42789] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:30,148 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,149 INFO [RS:1;jenkins-hbase4:42493] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:30,149 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:30,150 INFO [RS:1;jenkins-hbase4:42493] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:30,150 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,150 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:30,150 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:30,151 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70432314, jitterRate=0.04952326416969299}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:30,151 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:30,151 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,151 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:30,151 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:30,151 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:30,151 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 1 ms 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,152 DEBUG [RS:0;jenkins-hbase4:42789] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,155 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,156 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:30,156 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,156 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:30,156 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,156 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,156 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,156 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,157 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,157 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,157 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:30,157 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,157 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,157 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,157 DEBUG [RS:1;jenkins-hbase4:42493] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:30,158 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:30,158 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:30,158 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,158 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,158 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:30,162 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:30,163 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:30,172 INFO [RS:0;jenkins-hbase4:42789] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:30,172 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42789,1676836829804-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,174 INFO [RS:1;jenkins-hbase4:42493] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:30,174 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42493,1676836829827-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,186 INFO [RS:0;jenkins-hbase4:42789] regionserver.Replication(203): jenkins-hbase4.apache.org,42789,1676836829804 started 2023-02-19 20:00:30,186 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42789,1676836829804, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42789, sessionid=0x1006e2b63e30001 2023-02-19 20:00:30,186 INFO [RS:1;jenkins-hbase4:42493] regionserver.Replication(203): jenkins-hbase4.apache.org,42493,1676836829827 started 2023-02-19 20:00:30,186 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:30,186 DEBUG [RS:0;jenkins-hbase4:42789] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,186 DEBUG [RS:0;jenkins-hbase4:42789] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42789,1676836829804' 2023-02-19 20:00:30,186 DEBUG [RS:0;jenkins-hbase4:42789] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:30,186 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42493,1676836829827, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42493, sessionid=0x1006e2b63e30002 2023-02-19 20:00:30,186 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:30,186 DEBUG [RS:1;jenkins-hbase4:42493] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,186 DEBUG [RS:1;jenkins-hbase4:42493] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42493,1676836829827' 2023-02-19 20:00:30,186 DEBUG [RS:1;jenkins-hbase4:42493] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:30,186 DEBUG [RS:0;jenkins-hbase4:42789] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42789,1676836829804' 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42493,1676836829827' 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:30,187 DEBUG [RS:1;jenkins-hbase4:42493] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:30,187 DEBUG [RS:0;jenkins-hbase4:42789] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:30,187 INFO [RS:0;jenkins-hbase4:42789] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:30,187 INFO [RS:0;jenkins-hbase4:42789] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:30,188 DEBUG [RS:1;jenkins-hbase4:42493] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:30,188 INFO [RS:1;jenkins-hbase4:42493] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:30,188 INFO [RS:1;jenkins-hbase4:42493] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:30,314 DEBUG [jenkins-hbase4:34205] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:30,314 DEBUG [jenkins-hbase4:34205] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:30,319 DEBUG [jenkins-hbase4:34205] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:30,319 DEBUG [jenkins-hbase4:34205] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:30,319 DEBUG [jenkins-hbase4:34205] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:30,320 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42789,1676836829804, state=OPENING 2023-02-19 20:00:30,321 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:30,324 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:30,324 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:30,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:30,479 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,479 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:30,480 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48484, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:30,485 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:30,485 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:30,487 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42789%2C1676836829804.meta, suffix=.meta, logDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42789,1676836829804, archiveDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/oldWALs, maxLogs=32 2023-02-19 20:00:30,501 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK] 2023-02-19 20:00:30,501 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK] 2023-02-19 20:00:30,503 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42789,1676836829804/jenkins-hbase4.apache.org%2C42789%2C1676836829804.meta.1676836830487.meta 2023-02-19 20:00:30,503 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK], DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK]] 2023-02-19 20:00:30,503 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:30,503 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:30,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:30,504 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:30,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:30,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:30,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:30,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:30,505 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:30,506 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/info 2023-02-19 20:00:30,506 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/info 2023-02-19 20:00:30,506 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:30,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,507 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:30,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:30,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:30,508 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:30,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,508 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:30,510 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/table 2023-02-19 20:00:30,510 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/table 2023-02-19 20:00:30,510 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:30,510 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,511 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740 2023-02-19 20:00:30,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740 2023-02-19 20:00:30,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:30,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:30,516 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66864024, jitterRate=-0.00364840030670166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:30,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:30,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836830479 2023-02-19 20:00:30,522 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:30,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:30,522 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42789,1676836829804, state=OPEN 2023-02-19 20:00:30,524 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:30,524 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:30,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:30,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42789,1676836829804 in 200 msec 2023-02-19 20:00:30,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:30,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-19 20:00:30,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 494 msec 2023-02-19 20:00:30,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836830528, completionTime=-1 2023-02-19 20:00:30,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:30,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:30,532 DEBUG [hconnection-0x1bcc7df3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:30,533 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48498, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:30,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:30,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836890535 2023-02-19 20:00:30,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836950535 2023-02-19 20:00:30,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-19 20:00:30,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34205,1676836829761-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34205,1676836829761-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34205,1676836829761-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34205, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:30,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:30,542 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:30,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:30,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:30,545 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,545 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535 empty. 2023-02-19 20:00:30,546 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,546 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:30,555 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:30,556 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cb46ec196d5244590fb6075e421c4535, NAME => 'hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:30,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:30,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cb46ec196d5244590fb6075e421c4535, disabling compactions & flushes 2023-02-19 20:00:30,564 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. after waiting 0 ms 2023-02-19 20:00:30,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,564 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cb46ec196d5244590fb6075e421c4535: 2023-02-19 20:00:30,566 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:30,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836830567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836830567"}]},"ts":"1676836830567"} 2023-02-19 20:00:30,569 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:30,570 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:30,570 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836830570"}]},"ts":"1676836830570"} 2023-02-19 20:00:30,571 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:30,575 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:30,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:30,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:30,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:30,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cb46ec196d5244590fb6075e421c4535, ASSIGN}] 2023-02-19 20:00:30,582 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cb46ec196d5244590fb6075e421c4535, ASSIGN 2023-02-19 20:00:30,583 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cb46ec196d5244590fb6075e421c4535, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42789,1676836829804; forceNewPlan=false, retain=false 2023-02-19 20:00:30,733 INFO [jenkins-hbase4:34205] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:30,734 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cb46ec196d5244590fb6075e421c4535, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836830734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836830734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836830734"}]},"ts":"1676836830734"} 2023-02-19 20:00:30,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cb46ec196d5244590fb6075e421c4535, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:30,888 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:30,891 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,893 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42789%2C1676836829804, suffix=, logDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42789,1676836829804, archiveDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/oldWALs, maxLogs=32 2023-02-19 20:00:30,915 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK] 2023-02-19 20:00:30,916 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK] 2023-02-19 20:00:30,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42789,1676836829804/jenkins-hbase4.apache.org%2C42789%2C1676836829804.1676836830894 2023-02-19 20:00:30,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK], DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK]] 2023-02-19 20:00:30,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb46ec196d5244590fb6075e421c4535, NAME => 'hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:30,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:30,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,925 INFO [StoreOpener-cb46ec196d5244590fb6075e421c4535-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,930 DEBUG [StoreOpener-cb46ec196d5244590fb6075e421c4535-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/info 2023-02-19 20:00:30,930 DEBUG [StoreOpener-cb46ec196d5244590fb6075e421c4535-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/info 2023-02-19 20:00:30,931 INFO [StoreOpener-cb46ec196d5244590fb6075e421c4535-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb46ec196d5244590fb6075e421c4535 columnFamilyName info 2023-02-19 20:00:30,932 INFO [StoreOpener-cb46ec196d5244590fb6075e421c4535-1] regionserver.HStore(310): Store=cb46ec196d5244590fb6075e421c4535/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:30,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:30,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:30,952 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb46ec196d5244590fb6075e421c4535; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62300708, jitterRate=-0.07164710760116577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:30,952 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb46ec196d5244590fb6075e421c4535: 2023-02-19 20:00:30,953 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535., pid=6, masterSystemTime=1676836830887 2023-02-19 20:00:30,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,956 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:30,957 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cb46ec196d5244590fb6075e421c4535, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:30,957 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836830956"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836830956"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836830956"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836830956"}]},"ts":"1676836830956"} 2023-02-19 20:00:30,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:30,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cb46ec196d5244590fb6075e421c4535, server=jenkins-hbase4.apache.org,42789,1676836829804 in 223 msec 2023-02-19 20:00:30,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:30,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cb46ec196d5244590fb6075e421c4535, ASSIGN in 386 msec 2023-02-19 20:00:30,964 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:30,965 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836830965"}]},"ts":"1676836830965"} 2023-02-19 20:00:30,966 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:30,969 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:30,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 428 msec 2023-02-19 20:00:31,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:31,045 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:31,045 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:31,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:31,060 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:31,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-19 20:00:31,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:31,078 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:31,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-19 20:00:31,095 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:31,097 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:31,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.251sec 2023-02-19 20:00:31,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:31,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:31,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:31,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34205,1676836829761-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:31,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34205,1676836829761-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:31,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:31,179 DEBUG [Listener at localhost/34071] zookeeper.ReadOnlyZKClient(139): Connect 0x0f37f8b0 to 127.0.0.1:64895 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:31,185 DEBUG [Listener at localhost/34071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4690e9df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:31,186 DEBUG [hconnection-0x7ec775b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:31,188 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:31,190 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:31,190 INFO [RS:1;jenkins-hbase4:42493] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42493%2C1676836829827, suffix=, logDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42493,1676836829827, archiveDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/oldWALs, maxLogs=32 2023-02-19 20:00:31,190 DEBUG [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:31,192 DEBUG [Listener at localhost/34071] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:31,193 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:31,194 INFO [Listener at localhost/34071] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-19 20:00:31,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-19 20:00:31,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:31,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:55122 deadline: 1676836891194, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-19 20:00:31,195 INFO [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-19 20:00:31,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:31,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:31,200 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:31,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-19 20:00:31,200 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:31,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:31,207 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK] 2023-02-19 20:00:31,207 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK] 2023-02-19 20:00:31,209 INFO [RS:1;jenkins-hbase4:42493] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/WALs/jenkins-hbase4.apache.org,42493,1676836829827/jenkins-hbase4.apache.org%2C42493%2C1676836829827.1676836831190 2023-02-19 20:00:31,210 DEBUG [RS:1;jenkins-hbase4:42493] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46219,DS-55bfdfe3-8c8c-4cb5-be17-05f6816f15a9,DISK], DatanodeInfoWithStorage[127.0.0.1:46365,DS-b0a77a4b-f788-4d58-9e08-e5dbd255fc63,DISK]] 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,210 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c empty. 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 empty. 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 empty. 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 empty. 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 empty. 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 empty. 2023-02-19 20:00:31,211 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 empty. 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b empty. 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad empty. 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 empty. 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,212 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,213 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,213 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,213 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-19 20:00:31,224 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:31,225 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7855d59ce5c1132f4c201b83d50b7a24, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,225 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3a1aec21a772dd38d30033115974e100, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,225 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9a7e806d130de81480cad5ec53a91d9c, NAME => 'testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,236 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,236 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 7855d59ce5c1132f4c201b83d50b7a24, disabling compactions & flushes 2023-02-19 20:00:31,236 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. after waiting 0 ms 2023-02-19 20:00:31,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,237 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:31,237 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 95329ac9746b431efe4c0bef12df7632, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,239 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3a1aec21a772dd38d30033115974e100, disabling compactions & flushes 2023-02-19 20:00:31,240 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 9a7e806d130de81480cad5ec53a91d9c, disabling compactions & flushes 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. after waiting 0 ms 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,240 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,240 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. after waiting 0 ms 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,240 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,240 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:31,240 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 38836576615e75bf216da1fa8920c6a2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,241 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa88e7906e1842dca9a8e56745f8fdd6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,246 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,246 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 95329ac9746b431efe4c0bef12df7632, disabling compactions & flushes 2023-02-19 20:00:31,246 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,246 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,246 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. after waiting 0 ms 2023-02-19 20:00:31,246 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,246 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,246 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:31,247 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3bf13ef65ab32e662dce82729aa424d2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing aa88e7906e1842dca9a8e56745f8fdd6, disabling compactions & flushes 2023-02-19 20:00:31,250 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. after waiting 0 ms 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,250 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 38836576615e75bf216da1fa8920c6a2, disabling compactions & flushes 2023-02-19 20:00:31,250 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,250 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 569288db5ed13b1de225598cf6b75755, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. after waiting 0 ms 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,250 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,250 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:31,251 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => d26c3fff501a01e1164f454407d045ad, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 3bf13ef65ab32e662dce82729aa424d2, disabling compactions & flushes 2023-02-19 20:00:31,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. after waiting 0 ms 2023-02-19 20:00:31,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:31,254 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => bb95a71594e3fc2fea7f3667c254479b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp 2023-02-19 20:00:31,257 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,257 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 569288db5ed13b1de225598cf6b75755, disabling compactions & flushes 2023-02-19 20:00:31,257 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,257 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,257 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. after waiting 0 ms 2023-02-19 20:00:31,257 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,257 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,257 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:31,259 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,259 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing d26c3fff501a01e1164f454407d045ad, disabling compactions & flushes 2023-02-19 20:00:31,259 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,259 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,259 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. after waiting 0 ms 2023-02-19 20:00:31,259 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,259 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,259 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:31,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing bb95a71594e3fc2fea7f3667c254479b, disabling compactions & flushes 2023-02-19 20:00:31,260 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. after waiting 0 ms 2023-02-19 20:00:31,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,260 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,260 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:31,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836831262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836831262"}]},"ts":"1676836831262"} 2023-02-19 20:00:31,266 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 20:00:31,267 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:31,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836831267"}]},"ts":"1676836831267"} 2023-02-19 20:00:31,268 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-19 20:00:31,271 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:31,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:31,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:31,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:31,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, ASSIGN}] 2023-02-19 20:00:31,282 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, ASSIGN 2023-02-19 20:00:31,282 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, ASSIGN 2023-02-19 20:00:31,282 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, ASSIGN 2023-02-19 20:00:31,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, ASSIGN 2023-02-19 20:00:31,283 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42493,1676836829827; forceNewPlan=false, retain=false 2023-02-19 20:00:31,283 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42493,1676836829827; forceNewPlan=false, retain=false 2023-02-19 20:00:31,283 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42789,1676836829804; forceNewPlan=false, retain=false 2023-02-19 20:00:31,283 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42789,1676836829804; forceNewPlan=false, retain=false 2023-02-19 20:00:31,284 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, ASSIGN 2023-02-19 20:00:31,285 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42493,1676836829827; forceNewPlan=false, retain=false 2023-02-19 20:00:31,286 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, ASSIGN 2023-02-19 20:00:31,286 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42789,1676836829804; forceNewPlan=false, retain=false 2023-02-19 20:00:31,287 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, ASSIGN 2023-02-19 20:00:31,287 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42493,1676836829827; forceNewPlan=false, retain=false 2023-02-19 20:00:31,288 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, ASSIGN 2023-02-19 20:00:31,288 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, ASSIGN 2023-02-19 20:00:31,288 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, ASSIGN 2023-02-19 20:00:31,289 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42789,1676836829804; forceNewPlan=false, retain=false 2023-02-19 20:00:31,289 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42493,1676836829827; forceNewPlan=false, retain=false 2023-02-19 20:00:31,289 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42789,1676836829804; forceNewPlan=false, retain=false 2023-02-19 20:00:31,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:31,433 INFO [jenkins-hbase4:34205] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 20:00:31,440 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa88e7906e1842dca9a8e56745f8fdd6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,440 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3bf13ef65ab32e662dce82729aa424d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,440 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7855d59ce5c1132f4c201b83d50b7a24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,440 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831439"}]},"ts":"1676836831439"} 2023-02-19 20:00:31,440 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831439"}]},"ts":"1676836831439"} 2023-02-19 20:00:31,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d26c3fff501a01e1164f454407d045ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9a7e806d130de81480cad5ec53a91d9c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,440 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831439"}]},"ts":"1676836831439"} 2023-02-19 20:00:31,440 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831439"}]},"ts":"1676836831439"} 2023-02-19 20:00:31,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836831439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831439"}]},"ts":"1676836831439"} 2023-02-19 20:00:31,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure aa88e7906e1842dca9a8e56745f8fdd6, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:31,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure 3bf13ef65ab32e662dce82729aa424d2, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:31,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure d26c3fff501a01e1164f454407d045ad, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:31,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure 7855d59ce5c1132f4c201b83d50b7a24, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:31,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure 9a7e806d130de81480cad5ec53a91d9c, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:31,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=bb95a71594e3fc2fea7f3667c254479b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836831450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831450"}]},"ts":"1676836831450"} 2023-02-19 20:00:31,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure bb95a71594e3fc2fea7f3667c254479b, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:31,454 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=95329ac9746b431efe4c0bef12df7632, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,454 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831454"}]},"ts":"1676836831454"} 2023-02-19 20:00:31,454 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=38836576615e75bf216da1fa8920c6a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,454 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831454"}]},"ts":"1676836831454"} 2023-02-19 20:00:31,454 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=569288db5ed13b1de225598cf6b75755, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,455 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831454"}]},"ts":"1676836831454"} 2023-02-19 20:00:31,455 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3a1aec21a772dd38d30033115974e100, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,455 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836831455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836831455"}]},"ts":"1676836831455"} 2023-02-19 20:00:31,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 95329ac9746b431efe4c0bef12df7632, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:31,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 38836576615e75bf216da1fa8920c6a2, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:31,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 569288db5ed13b1de225598cf6b75755, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:31,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure 3a1aec21a772dd38d30033115974e100, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:31,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:31,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3bf13ef65ab32e662dce82729aa424d2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 20:00:31,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,599 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,600 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1 2023-02-19 20:00:31,600 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1 2023-02-19 20:00:31,601 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bf13ef65ab32e662dce82729aa424d2 columnFamilyName f1 2023-02-19 20:00:31,601 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(310): Store=3bf13ef65ab32e662dce82729aa424d2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,601 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,602 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2 2023-02-19 20:00:31,602 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2 2023-02-19 20:00:31,603 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bf13ef65ab32e662dce82729aa424d2 columnFamilyName f2 2023-02-19 20:00:31,603 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(310): Store=3bf13ef65ab32e662dce82729aa424d2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,606 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,606 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:31,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:31,608 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:31,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3bf13ef65ab32e662dce82729aa424d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64115429, jitterRate=-0.04460565745830536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:31,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2., pid=22, masterSystemTime=1676836831594 2023-02-19 20:00:31,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bb95a71594e3fc2fea7f3667c254479b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 20:00:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:31,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7855d59ce5c1132f4c201b83d50b7a24, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 20:00:31,612 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3bf13ef65ab32e662dce82729aa424d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,612 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831612"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831612"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831612"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831612"}]},"ts":"1676836831612"} 2023-02-19 20:00:31,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,613 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,614 DEBUG [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f1 2023-02-19 20:00:31,614 DEBUG [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f1 2023-02-19 20:00:31,614 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,615 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb95a71594e3fc2fea7f3667c254479b columnFamilyName f1 2023-02-19 20:00:31,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-19 20:00:31,615 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(310): Store=bb95a71594e3fc2fea7f3667c254479b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure 3bf13ef65ab32e662dce82729aa424d2, server=jenkins-hbase4.apache.org,42789,1676836829804 in 171 msec 2023-02-19 20:00:31,615 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,616 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1 2023-02-19 20:00:31,616 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1 2023-02-19 20:00:31,616 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7855d59ce5c1132f4c201b83d50b7a24 columnFamilyName f1 2023-02-19 20:00:31,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, ASSIGN in 336 msec 2023-02-19 20:00:31,616 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(310): Store=7855d59ce5c1132f4c201b83d50b7a24/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,617 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,617 DEBUG [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f2 2023-02-19 20:00:31,617 DEBUG [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f2 2023-02-19 20:00:31,617 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb95a71594e3fc2fea7f3667c254479b columnFamilyName f2 2023-02-19 20:00:31,617 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(310): Store=bb95a71594e3fc2fea7f3667c254479b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,618 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2 2023-02-19 20:00:31,618 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2 2023-02-19 20:00:31,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,618 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7855d59ce5c1132f4c201b83d50b7a24 columnFamilyName f2 2023-02-19 20:00:31,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,618 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(310): Store=7855d59ce5c1132f4c201b83d50b7a24/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:31,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:31,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bb95a71594e3fc2fea7f3667c254479b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60186138, jitterRate=-0.10315665602684021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:31,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b., pid=26, masterSystemTime=1676836831606 2023-02-19 20:00:31,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7855d59ce5c1132f4c201b83d50b7a24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61287164, jitterRate=-0.0867500901222229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:31,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24., pid=24, masterSystemTime=1676836831594 2023-02-19 20:00:31,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:31,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3a1aec21a772dd38d30033115974e100, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 20:00:31,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=bb95a71594e3fc2fea7f3667c254479b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836831628"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831628"}]},"ts":"1676836831628"} 2023-02-19 20:00:31,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa88e7906e1842dca9a8e56745f8fdd6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 20:00:31,631 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7855d59ce5c1132f4c201b83d50b7a24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,631 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831631"}]},"ts":"1676836831631"} 2023-02-19 20:00:31,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,632 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,634 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1 2023-02-19 20:00:31,634 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1 2023-02-19 20:00:31,634 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa88e7906e1842dca9a8e56745f8fdd6 columnFamilyName f1 2023-02-19 20:00:31,635 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(310): Store=aa88e7906e1842dca9a8e56745f8fdd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,635 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-19 20:00:31,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure bb95a71594e3fc2fea7f3667c254479b, server=jenkins-hbase4.apache.org,42493,1676836829827 in 179 msec 2023-02-19 20:00:31,637 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2 2023-02-19 20:00:31,637 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2 2023-02-19 20:00:31,637 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa88e7906e1842dca9a8e56745f8fdd6 columnFamilyName f2 2023-02-19 20:00:31,638 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(310): Store=aa88e7906e1842dca9a8e56745f8fdd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-19 20:00:31,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, ASSIGN in 357 msec 2023-02-19 20:00:31,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure 7855d59ce5c1132f4c201b83d50b7a24, server=jenkins-hbase4.apache.org,42789,1676836829804 in 190 msec 2023-02-19 20:00:31,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, ASSIGN in 360 msec 2023-02-19 20:00:31,641 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,643 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1 2023-02-19 20:00:31,643 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1 2023-02-19 20:00:31,643 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1aec21a772dd38d30033115974e100 columnFamilyName f1 2023-02-19 20:00:31,644 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(310): Store=3a1aec21a772dd38d30033115974e100/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,644 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:31,645 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2 2023-02-19 20:00:31,645 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2 2023-02-19 20:00:31,645 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1aec21a772dd38d30033115974e100 columnFamilyName f2 2023-02-19 20:00:31,646 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(310): Store=3a1aec21a772dd38d30033115974e100/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aa88e7906e1842dca9a8e56745f8fdd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61376407, jitterRate=-0.08542026579380035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:31,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6., pid=21, masterSystemTime=1676836831594 2023-02-19 20:00:31,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:31,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9a7e806d130de81480cad5ec53a91d9c, NAME => 'testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 20:00:31,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa88e7906e1842dca9a8e56745f8fdd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,653 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831653"}]},"ts":"1676836831653"} 2023-02-19 20:00:31,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,655 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:31,656 DEBUG [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f1 2023-02-19 20:00:31,657 DEBUG [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f1 2023-02-19 20:00:31,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-19 20:00:31,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure aa88e7906e1842dca9a8e56745f8fdd6, server=jenkins-hbase4.apache.org,42789,1676836829804 in 214 msec 2023-02-19 20:00:31,657 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a7e806d130de81480cad5ec53a91d9c columnFamilyName f1 2023-02-19 20:00:31,657 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(310): Store=9a7e806d130de81480cad5ec53a91d9c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,658 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, ASSIGN in 378 msec 2023-02-19 20:00:31,659 DEBUG [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f2 2023-02-19 20:00:31,659 DEBUG [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f2 2023-02-19 20:00:31,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,659 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a7e806d130de81480cad5ec53a91d9c columnFamilyName f2 2023-02-19 20:00:31,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3a1aec21a772dd38d30033115974e100; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68900298, jitterRate=0.026694446802139282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:31,660 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(310): Store=9a7e806d130de81480cad5ec53a91d9c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100., pid=30, masterSystemTime=1676836831606 2023-02-19 20:00:31,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3a1aec21a772dd38d30033115974e100, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 95329ac9746b431efe4c0bef12df7632, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 20:00:31,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831662"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831662"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831662"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831662"}]},"ts":"1676836831662"} 2023-02-19 20:00:31,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-19 20:00:31,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure 3a1aec21a772dd38d30033115974e100, server=jenkins-hbase4.apache.org,42493,1676836829827 in 205 msec 2023-02-19 20:00:31,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:31,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, ASSIGN in 387 msec 2023-02-19 20:00:31,668 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,669 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1 2023-02-19 20:00:31,669 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1 2023-02-19 20:00:31,669 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95329ac9746b431efe4c0bef12df7632 columnFamilyName f1 2023-02-19 20:00:31,670 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(310): Store=95329ac9746b431efe4c0bef12df7632/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,670 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,673 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2 2023-02-19 20:00:31,673 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2 2023-02-19 20:00:31,674 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95329ac9746b431efe4c0bef12df7632 columnFamilyName f2 2023-02-19 20:00:31,674 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(310): Store=95329ac9746b431efe4c0bef12df7632/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9a7e806d130de81480cad5ec53a91d9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72564446, jitterRate=0.08129450678825378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:31,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c., pid=25, masterSystemTime=1676836831594 2023-02-19 20:00:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:31,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d26c3fff501a01e1164f454407d045ad, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 20:00:31,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:31,679 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9a7e806d130de81480cad5ec53a91d9c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,679 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836831679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831679"}]},"ts":"1676836831679"} 2023-02-19 20:00:31,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-19 20:00:31,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure 9a7e806d130de81480cad5ec53a91d9c, server=jenkins-hbase4.apache.org,42789,1676836829804 in 236 msec 2023-02-19 20:00:31,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, ASSIGN in 404 msec 2023-02-19 20:00:31,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 95329ac9746b431efe4c0bef12df7632; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62269570, jitterRate=-0.0721110999584198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,685 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:31,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632., pid=27, masterSystemTime=1676836831606 2023-02-19 20:00:31,687 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1 2023-02-19 20:00:31,687 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1 2023-02-19 20:00:31,687 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26c3fff501a01e1164f454407d045ad columnFamilyName f1 2023-02-19 20:00:31,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,688 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(310): Store=d26c3fff501a01e1164f454407d045ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:31,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=95329ac9746b431efe4c0bef12df7632, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,688 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 569288db5ed13b1de225598cf6b75755, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 20:00:31,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831688"}]},"ts":"1676836831688"} 2023-02-19 20:00:31,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,690 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2 2023-02-19 20:00:31,690 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2 2023-02-19 20:00:31,690 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26c3fff501a01e1164f454407d045ad columnFamilyName f2 2023-02-19 20:00:31,690 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-19 20:00:31,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 95329ac9746b431efe4c0bef12df7632, server=jenkins-hbase4.apache.org,42493,1676836829827 in 235 msec 2023-02-19 20:00:31,692 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1 2023-02-19 20:00:31,692 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1 2023-02-19 20:00:31,692 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(310): Store=d26c3fff501a01e1164f454407d045ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,692 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 569288db5ed13b1de225598cf6b75755 columnFamilyName f1 2023-02-19 20:00:31,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,693 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(310): Store=569288db5ed13b1de225598cf6b75755/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,693 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,695 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2 2023-02-19 20:00:31,695 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2 2023-02-19 20:00:31,695 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 569288db5ed13b1de225598cf6b75755 columnFamilyName f2 2023-02-19 20:00:31,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,696 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(310): Store=569288db5ed13b1de225598cf6b75755/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, ASSIGN in 413 msec 2023-02-19 20:00:31,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:31,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d26c3fff501a01e1164f454407d045ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74574175, jitterRate=0.11124180257320404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:31,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad., pid=23, masterSystemTime=1676836831594 2023-02-19 20:00:31,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:31,704 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d26c3fff501a01e1164f454407d045ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:31,704 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831704"}]},"ts":"1676836831704"} 2023-02-19 20:00:31,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:31,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-19 20:00:31,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure d26c3fff501a01e1164f454407d045ad, server=jenkins-hbase4.apache.org,42789,1676836829804 in 261 msec 2023-02-19 20:00:31,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 569288db5ed13b1de225598cf6b75755; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60942584, jitterRate=-0.09188473224639893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:31,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, ASSIGN in 428 msec 2023-02-19 20:00:31,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755., pid=29, masterSystemTime=1676836831606 2023-02-19 20:00:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:31,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38836576615e75bf216da1fa8920c6a2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 20:00:31,710 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=569288db5ed13b1de225598cf6b75755, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,710 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831710"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831710"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831710"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831710"}]},"ts":"1676836831710"} 2023-02-19 20:00:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,712 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-19 20:00:31,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 569288db5ed13b1de225598cf6b75755, server=jenkins-hbase4.apache.org,42493,1676836829827 in 253 msec 2023-02-19 20:00:31,714 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1 2023-02-19 20:00:31,714 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1 2023-02-19 20:00:31,715 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38836576615e75bf216da1fa8920c6a2 columnFamilyName f1 2023-02-19 20:00:31,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, ASSIGN in 435 msec 2023-02-19 20:00:31,715 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(310): Store=38836576615e75bf216da1fa8920c6a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,715 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,716 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2 2023-02-19 20:00:31,716 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2 2023-02-19 20:00:31,717 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38836576615e75bf216da1fa8920c6a2 columnFamilyName f2 2023-02-19 20:00:31,717 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(310): Store=38836576615e75bf216da1fa8920c6a2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:31,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:31,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:31,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 38836576615e75bf216da1fa8920c6a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67501829, jitterRate=0.005855634808540344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:31,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2., pid=28, masterSystemTime=1676836831606 2023-02-19 20:00:31,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:31,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=38836576615e75bf216da1fa8920c6a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:31,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836831730"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836831730"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836831730"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836831730"}]},"ts":"1676836831730"} 2023-02-19 20:00:31,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-19 20:00:31,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 38836576615e75bf216da1fa8920c6a2, server=jenkins-hbase4.apache.org,42493,1676836829827 in 274 msec 2023-02-19 20:00:31,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-19 20:00:31,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, ASSIGN in 454 msec 2023-02-19 20:00:31,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:31,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836831735"}]},"ts":"1676836831735"} 2023-02-19 20:00:31,737 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-19 20:00:31,741 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:31,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 544 msec 2023-02-19 20:00:31,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:31,806 INFO [Listener at localhost/34071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-19 20:00:31,806 DEBUG [Listener at localhost/34071] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-19 20:00:31,806 INFO [Listener at localhost/34071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:31,809 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-19 20:00:31,809 INFO [Listener at localhost/34071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:31,809 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-19 20:00:31,809 INFO [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:31,842 DEBUG [hconnection-0x7ec775b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:31,874 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:31,881 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42789] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:31,882 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42493] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:31,958 INFO [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:31,958 INFO [Listener at localhost/34071] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:31,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 20:00:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836831959 (current time:1676836831959). 2023-02-19 20:00:31,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:31,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] zookeeper.ReadOnlyZKClient(139): Connect 0x0d53a59f to 127.0.0.1:64895 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:31,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ee62070, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:31,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:31,967 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:31,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d53a59f to 127.0.0.1:64895 2023-02-19 20:00:31,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:31,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:31,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 20:00:31,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 20:00:31,972 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 20:00:31,973 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676837431972 2023-02-19 20:00:31,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 20:00:31,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-19 20:00:31,974 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:31,974 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:31,975 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 20:00:31,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 20:00:31,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-19 20:00:31,976 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 20:00:31,977 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676837431977 2023-02-19 20:00:32,074 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:32,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 20:00:32,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:32,075 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:32,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,092 INFO [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-19 20:00:32,092 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:32,092 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-19 20:00:32,092 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 20:00:32,093 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,093 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,094 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:32,094 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:32,094 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:32,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:32,095 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,095 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,095 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,095 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:32,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-19 20:00:32,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-19 20:00:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-19 20:00:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:00:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 20:00:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42493,1676836829827' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 20:00:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:00:32,102 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 20:00:32,103 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42789,1676836829804' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 20:00:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,104 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:32,105 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,106 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:32,105 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,106 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:32,106 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,106 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42493,1676836829827' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c26cab0[Count = 1] remaining members to acquire global barrier 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:32,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42789,1676836829804' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 20:00:32,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c26cab0[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:32,112 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 20:00:32,113 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:32,114 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:32,115 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:32,115 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. started... 2023-02-19 20:00:32,115 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,121 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:00:32,121 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:32,121 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:32,121 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. started... 2023-02-19 20:00:32,121 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:32,122 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. started... 2023-02-19 20:00:32,122 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:32,122 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:32,122 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. started... 2023-02-19 20:00:32,122 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,132 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 20:00:32,132 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:32,132 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:32,132 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. started... 2023-02-19 20:00:32,132 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:32,132 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. started... 2023-02-19 20:00:32,136 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,136 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:32,138 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d26c3fff501a01e1164f454407d045ad 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:00:32,138 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 569288db5ed13b1de225598cf6b75755 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:32,138 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3a1aec21a772dd38d30033115974e100 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 20:00:32,139 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,139 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:32,139 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:32,139 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:32,139 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7855d59ce5c1132f4c201b83d50b7a24 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:32,140 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,141 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,141 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:32,141 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 20:00:32,172 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. completed. 2023-02-19 20:00:32,172 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:32,172 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:00:32,172 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. started... 2023-02-19 20:00:32,173 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 95329ac9746b431efe4c0bef12df7632 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:32,176 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. completed. 2023-02-19 20:00:32,176 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:32,176 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:32,176 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. started... 2023-02-19 20:00:32,176 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 20:00:32,183 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HRegion(2744): Flushing aa88e7906e1842dca9a8e56745f8fdd6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:32,189 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f1/0b0279816c774f0c9ebae069e1b258b9 2023-02-19 20:00:32,190 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f1/34a80e1c35be455c9faf1031b379c8a6 2023-02-19 20:00:32,192 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f1/a8445d1afc054ac592eadf9eaeda0a05 2023-02-19 20:00:32,194 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f1/da5edb339a48498c85ba14d5e3f2f487 2023-02-19 20:00:32,200 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f1/1730b76f4baa49c1a064d643537dd816 2023-02-19 20:00:32,260 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f2/3a24f3f28037491783adbb2549953dfa 2023-02-19 20:00:32,269 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f2/459e0a0b29db49399400ab436cde49eb 2023-02-19 20:00:32,269 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f1/a8445d1afc054ac592eadf9eaeda0a05 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/a8445d1afc054ac592eadf9eaeda0a05 2023-02-19 20:00:32,270 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f2/b919b8752f474de4ae01cfd08d13b66a 2023-02-19 20:00:32,274 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f2/d1590f7638aa4e3e8d41923c6da99c1d 2023-02-19 20:00:32,275 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:32,276 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f1/34a80e1c35be455c9faf1031b379c8a6 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/34a80e1c35be455c9faf1031b379c8a6 2023-02-19 20:00:32,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 20:00:32,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:32,278 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 20:00:32,278 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/a8445d1afc054ac592eadf9eaeda0a05, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,279 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f2/3a24f3f28037491783adbb2549953dfa as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/3a24f3f28037491783adbb2549953dfa 2023-02-19 20:00:32,280 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f1/0b0279816c774f0c9ebae069e1b258b9 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/0b0279816c774f0c9ebae069e1b258b9 2023-02-19 20:00:32,280 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f1/1730b76f4baa49c1a064d643537dd816 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/1730b76f4baa49c1a064d643537dd816 2023-02-19 20:00:32,282 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/34a80e1c35be455c9faf1031b379c8a6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,283 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f2/138094fe31d5445dbd4794fc2597f744 2023-02-19 20:00:32,284 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f2/459e0a0b29db49399400ab436cde49eb as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/459e0a0b29db49399400ab436cde49eb 2023-02-19 20:00:32,287 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/0b0279816c774f0c9ebae069e1b258b9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:32,288 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f2/b919b8752f474de4ae01cfd08d13b66a as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b919b8752f474de4ae01cfd08d13b66a 2023-02-19 20:00:32,292 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/1730b76f4baa49c1a064d643537dd816, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,293 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f2/d1590f7638aa4e3e8d41923c6da99c1d as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/d1590f7638aa4e3e8d41923c6da99c1d 2023-02-19 20:00:32,296 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/3a24f3f28037491783adbb2549953dfa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,296 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f1/da5edb339a48498c85ba14d5e3f2f487 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/da5edb339a48498c85ba14d5e3f2f487 2023-02-19 20:00:32,296 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b919b8752f474de4ae01cfd08d13b66a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:32,296 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/459e0a0b29db49399400ab436cde49eb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,297 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7855d59ce5c1132f4c201b83d50b7a24 in 158ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,297 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:32,298 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/d1590f7638aa4e3e8d41923c6da99c1d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/a8445d1afc054ac592eadf9eaeda0a05] hfiles 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/a8445d1afc054ac592eadf9eaeda0a05 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/3a24f3f28037491783adbb2549953dfa] hfiles 2023-02-19 20:00:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/3a24f3f28037491783adbb2549953dfa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,300 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3a1aec21a772dd38d30033115974e100 in 162ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,300 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 569288db5ed13b1de225598cf6b75755 in 162ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:32,300 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 95329ac9746b431efe4c0bef12df7632 in 127ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/34a80e1c35be455c9faf1031b379c8a6] hfiles 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/34a80e1c35be455c9faf1031b379c8a6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/459e0a0b29db49399400ab436cde49eb] hfiles 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/459e0a0b29db49399400ab436cde49eb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/0b0279816c774f0c9ebae069e1b258b9] hfiles 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/0b0279816c774f0c9ebae069e1b258b9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b919b8752f474de4ae01cfd08d13b66a] hfiles 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b919b8752f474de4ae01cfd08d13b66a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,302 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/da5edb339a48498c85ba14d5e3f2f487, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/1730b76f4baa49c1a064d643537dd816] hfiles 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/1730b76f4baa49c1a064d643537dd816 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/d1590f7638aa4e3e8d41923c6da99c1d] hfiles 2023-02-19 20:00:32,302 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/d1590f7638aa4e3e8d41923c6da99c1d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,304 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f2/138094fe31d5445dbd4794fc2597f744 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/138094fe31d5445dbd4794fc2597f744 2023-02-19 20:00:32,326 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. completed. 2023-02-19 20:00:32,326 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:32,326 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:32,326 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:00:32,326 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. started... 2023-02-19 20:00:32,328 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 38836576615e75bf216da1fa8920c6a2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:32,331 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/138094fe31d5445dbd4794fc2597f744, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 20:00:32,332 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d26c3fff501a01e1164f454407d045ad in 194ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. completed. 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,332 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. completed. 2023-02-19 20:00:32,333 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,332 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:32,333 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/da5edb339a48498c85ba14d5e3f2f487] hfiles 2023-02-19 20:00:32,333 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:00:32,333 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/da5edb339a48498c85ba14d5e3f2f487 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,333 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. started... 2023-02-19 20:00:32,333 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/138094fe31d5445dbd4794fc2597f744] hfiles 2023-02-19 20:00:32,333 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/138094fe31d5445dbd4794fc2597f744 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,334 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3bf13ef65ab32e662dce82729aa424d2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 20:00:32,339 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. completed. 2023-02-19 20:00:32,340 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:32,340 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:00:32,356 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. completed. 2023-02-19 20:00:32,357 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:32,357 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 20:00:32,362 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f1/0abfa793796a4bcabacab0b2761db909 2023-02-19 20:00:32,362 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f1/0752bb09c5474a2cb498f71e24019d8d 2023-02-19 20:00:32,383 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f2/f0686e741f0441c4ad7b94afc1c847ba 2023-02-19 20:00:32,385 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f2/265ffcfa0d974e3caf4c4b73944011b4 2023-02-19 20:00:32,389 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f1/0abfa793796a4bcabacab0b2761db909 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/0abfa793796a4bcabacab0b2761db909 2023-02-19 20:00:32,391 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f1/0752bb09c5474a2cb498f71e24019d8d as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/0752bb09c5474a2cb498f71e24019d8d 2023-02-19 20:00:32,394 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/0abfa793796a4bcabacab0b2761db909, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,395 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f2/f0686e741f0441c4ad7b94afc1c847ba as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/f0686e741f0441c4ad7b94afc1c847ba 2023-02-19 20:00:32,396 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/0752bb09c5474a2cb498f71e24019d8d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,397 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f2/265ffcfa0d974e3caf4c4b73944011b4 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/265ffcfa0d974e3caf4c4b73944011b4 2023-02-19 20:00:32,400 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/f0686e741f0441c4ad7b94afc1c847ba, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,401 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 38836576615e75bf216da1fa8920c6a2 in 73ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/0abfa793796a4bcabacab0b2761db909] hfiles 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/0abfa793796a4bcabacab0b2761db909 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/f0686e741f0441c4ad7b94afc1c847ba] hfiles 2023-02-19 20:00:32,401 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/f0686e741f0441c4ad7b94afc1c847ba for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,403 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/265ffcfa0d974e3caf4c4b73944011b4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,404 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3bf13ef65ab32e662dce82729aa424d2 in 70ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/0752bb09c5474a2cb498f71e24019d8d] hfiles 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/0752bb09c5474a2cb498f71e24019d8d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/265ffcfa0d974e3caf4c4b73944011b4] hfiles 2023-02-19 20:00:32,404 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/265ffcfa0d974e3caf4c4b73944011b4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,414 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. completed. 2023-02-19 20:00:32,414 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:00:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:00:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 20:00:32,414 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42493,1676836829827' in zk 2023-02-19 20:00:32,416 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:00:32,416 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,416 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,416 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 20:00:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:32,419 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. completed. 2023-02-19 20:00:32,419 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:32,419 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 20:00:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42493,1676836829827': 2023-02-19 20:00:32,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42493,1676836829827' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 20:00:32,578 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:32,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 20:00:32,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:32,580 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 20:00:32,611 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f1/5896967539f447e8b9fb99399992207d 2023-02-19 20:00:32,640 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f2/1649f5fedf2541299c6fc875edfd5802 2023-02-19 20:00:32,645 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f1/5896967539f447e8b9fb99399992207d as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/5896967539f447e8b9fb99399992207d 2023-02-19 20:00:32,649 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/5896967539f447e8b9fb99399992207d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,650 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f2/1649f5fedf2541299c6fc875edfd5802 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/1649f5fedf2541299c6fc875edfd5802 2023-02-19 20:00:32,654 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/1649f5fedf2541299c6fc875edfd5802, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 20:00:32,655 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for aa88e7906e1842dca9a8e56745f8fdd6 in 472ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:32,655 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:32,655 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,655 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:32,655 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/5896967539f447e8b9fb99399992207d] hfiles 2023-02-19 20:00:32,655 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/5896967539f447e8b9fb99399992207d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,656 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/1649f5fedf2541299c6fc875edfd5802] hfiles 2023-02-19 20:00:32,656 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/1649f5fedf2541299c6fc875edfd5802 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,662 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. completed. 2023-02-19 20:00:32,662 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 20:00:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 20:00:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 20:00:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42789,1676836829804' in zk 2023-02-19 20:00:32,664 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:00:32,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:32,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:32,664 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:32,665 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 20:00:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42789,1676836829804': 2023-02-19 20:00:32,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42789,1676836829804' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:32,670 INFO [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-19 20:00:32,670 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:32,670 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:32,670 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,670 INFO [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:32,673 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,673 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,673 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,673 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:32,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:32,673 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,674 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:32,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:32,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:32,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:32,675 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,676 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,677 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:32,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:32,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:32,683 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:32,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:32,682 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:32,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,683 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,683 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:32,683 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,683 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:32,683 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,683 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:32,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:32,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-19 20:00:32,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,739 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:32,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676836831973Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676836832683 (+710 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676836832683Writing data manifest for testWithMockedMapReduceMultiRegion at 1676836832691 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676836832703 (+12 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676836832739 (+36 ms) 2023-02-19 20:00:32,741 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 20:00:32,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 767 msec 2023-02-19 20:00:33,080 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:33,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 20:00:33,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:33,081 INFO [Listener at localhost/34071] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:33,085 INFO [Listener at localhost/34071] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:33,091 INFO [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:33,117 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42789] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,117 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42493] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,173 INFO [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:33,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:33,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,180 INFO [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-19 20:00:33,180 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:33,181 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-19 20:00:33,181 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 20:00:33,182 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,182 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,183 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:33,183 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:33,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:33,183 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,184 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,184 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:33,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,185 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,185 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-19 20:00:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-19 20:00:33,190 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:00:33,190 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:33,192 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 20:00:33,192 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:33,192 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. started... 2023-02-19 20:00:33,192 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:33,192 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:33,193 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:33,193 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. started... 2023-02-19 20:00:33,193 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d26c3fff501a01e1164f454407d045ad 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 20:00:33,193 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,193 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. started... 2023-02-19 20:00:33,194 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3a1aec21a772dd38d30033115974e100 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 20:00:33,194 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:33,194 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. started... 2023-02-19 20:00:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 20:00:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 20:00:33,194 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,194 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. started... 2023-02-19 20:00:33,194 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:33,195 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:33,195 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7855d59ce5c1132f4c201b83d50b7a24 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 20:00:33,196 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:33,195 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. started... 2023-02-19 20:00:33,195 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:33,196 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:33,196 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. started... 2023-02-19 20:00:33,196 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 569288db5ed13b1de225598cf6b75755 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:33,196 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aa88e7906e1842dca9a8e56745f8fdd6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:33,196 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 20:00:33,196 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:33,196 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. started... 2023-02-19 20:00:33,197 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 95329ac9746b431efe4c0bef12df7632 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:33,230 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f1/c984b64a3064475abaf0bd89b228298c 2023-02-19 20:00:33,230 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f1/973579db463d428c87c7aad19eac1ec0 2023-02-19 20:00:33,236 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f1/69e5dbbe5d094772b5b54dfdf7ce829f 2023-02-19 20:00:33,246 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f1/bc206c48cdbd4874b85752e0fe722d9c 2023-02-19 20:00:33,258 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f1/ed39c4f58e3a4eecbe473675a033305f 2023-02-19 20:00:33,264 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f2/b79dc5a4a92343738ad00e7c9a950540 2023-02-19 20:00:33,264 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f2/d2f07a2ba6c84220b988c3ef1d774f4d 2023-02-19 20:00:33,269 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f1/c984b64a3064475abaf0bd89b228298c as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/c984b64a3064475abaf0bd89b228298c 2023-02-19 20:00:33,272 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f1/973579db463d428c87c7aad19eac1ec0 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/973579db463d428c87c7aad19eac1ec0 2023-02-19 20:00:33,273 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/c984b64a3064475abaf0bd89b228298c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,274 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/.tmp/f2/d2f07a2ba6c84220b988c3ef1d774f4d as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/d2f07a2ba6c84220b988c3ef1d774f4d 2023-02-19 20:00:33,277 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/973579db463d428c87c7aad19eac1ec0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:33,277 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/.tmp/f2/b79dc5a4a92343738ad00e7c9a950540 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b79dc5a4a92343738ad00e7c9a950540 2023-02-19 20:00:33,278 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/d2f07a2ba6c84220b988c3ef1d774f4d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,278 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7855d59ce5c1132f4c201b83d50b7a24 in 83ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,278 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:33,278 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,281 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b79dc5a4a92343738ad00e7c9a950540, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:33,281 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3a1aec21a772dd38d30033115974e100 in 87ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,281 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:33,281 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,281 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:33,281 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 20:00:33,281 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. started... 2023-02-19 20:00:33,281 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 38836576615e75bf216da1fa8920c6a2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:33,286 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:33,286 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. started... 2023-02-19 20:00:33,286 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 20:00:33,286 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3bf13ef65ab32e662dce82729aa424d2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 20:00:33,291 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f2/837eb68ecdb34848bc32188d706e9b4d 2023-02-19 20:00:33,296 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f1/bc206c48cdbd4874b85752e0fe722d9c as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/bc206c48cdbd4874b85752e0fe722d9c 2023-02-19 20:00:33,299 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f1/366cb1326b3d41619554623178d637a2 2023-02-19 20:00:33,300 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/bc206c48cdbd4874b85752e0fe722d9c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,301 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/.tmp/f2/837eb68ecdb34848bc32188d706e9b4d as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/837eb68ecdb34848bc32188d706e9b4d 2023-02-19 20:00:33,304 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/837eb68ecdb34848bc32188d706e9b4d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,305 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 95329ac9746b431efe4c0bef12df7632 in 109ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,305 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:33,305 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 20:00:33,309 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f2/47488252c3a645bca213a32e982be57f 2023-02-19 20:00:33,312 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f1/366cb1326b3d41619554623178d637a2 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/366cb1326b3d41619554623178d637a2 2023-02-19 20:00:33,315 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/366cb1326b3d41619554623178d637a2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,316 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/.tmp/f2/47488252c3a645bca213a32e982be57f as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/47488252c3a645bca213a32e982be57f 2023-02-19 20:00:33,319 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/47488252c3a645bca213a32e982be57f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,320 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3bf13ef65ab32e662dce82729aa424d2 in 34ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,320 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:33,320 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:33,320 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 20:00:33,644 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f1/fb048b1003f24a099010a0d27454951a 2023-02-19 20:00:33,655 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f2/ca3d89a127374ee0acf5a0ba03fb3c8d 2023-02-19 20:00:33,659 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f1/fb048b1003f24a099010a0d27454951a as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/fb048b1003f24a099010a0d27454951a 2023-02-19 20:00:33,663 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/fb048b1003f24a099010a0d27454951a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,663 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/.tmp/f2/ca3d89a127374ee0acf5a0ba03fb3c8d as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/ca3d89a127374ee0acf5a0ba03fb3c8d 2023-02-19 20:00:33,667 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/ca3d89a127374ee0acf5a0ba03fb3c8d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,667 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for aa88e7906e1842dca9a8e56745f8fdd6 in 471ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,668 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:33,668 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:33,668 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 20:00:33,691 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f2/a4dbc1d0fbd24f6893dd842fdd706037 2023-02-19 20:00:33,692 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f2/0fd70b96c5644334aa5d51f09595d164 2023-02-19 20:00:33,695 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f1/69e5dbbe5d094772b5b54dfdf7ce829f as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/69e5dbbe5d094772b5b54dfdf7ce829f 2023-02-19 20:00:33,696 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f1/ed39c4f58e3a4eecbe473675a033305f as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/ed39c4f58e3a4eecbe473675a033305f 2023-02-19 20:00:33,698 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f1/19de56152bbd4ac6a06a47802dfb5063 2023-02-19 20:00:33,698 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/69e5dbbe5d094772b5b54dfdf7ce829f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:33,700 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/.tmp/f2/a4dbc1d0fbd24f6893dd842fdd706037 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/a4dbc1d0fbd24f6893dd842fdd706037 2023-02-19 20:00:33,701 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/ed39c4f58e3a4eecbe473675a033305f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,702 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/.tmp/f2/0fd70b96c5644334aa5d51f09595d164 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/0fd70b96c5644334aa5d51f09595d164 2023-02-19 20:00:33,709 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/a4dbc1d0fbd24f6893dd842fdd706037, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 20:00:33,710 INFO [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d26c3fff501a01e1164f454407d045ad in 517ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,710 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:33,710 DEBUG [rs(jenkins-hbase4.apache.org,42789,1676836829804)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:33,710 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 20:00:33,710 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 20:00:33,710 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,710 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/0fd70b96c5644334aa5d51f09595d164, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,711 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 569288db5ed13b1de225598cf6b75755 in 515ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,711 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:33,711 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:33,711 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 20:00:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 20:00:33,712 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42789,1676836829804' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 20:00:33,713 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:33,714 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:33,714 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,714 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:33,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:33,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42789,1676836829804' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 20:00:33,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681953ec[Count = 1] remaining members to acquire global barrier 2023-02-19 20:00:33,723 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f2/87b94c2e10ec4ea4b9577d0efa169ba7 2023-02-19 20:00:33,727 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f1/19de56152bbd4ac6a06a47802dfb5063 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/19de56152bbd4ac6a06a47802dfb5063 2023-02-19 20:00:33,730 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/19de56152bbd4ac6a06a47802dfb5063, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,731 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/.tmp/f2/87b94c2e10ec4ea4b9577d0efa169ba7 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/87b94c2e10ec4ea4b9577d0efa169ba7 2023-02-19 20:00:33,734 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/87b94c2e10ec4ea4b9577d0efa169ba7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 20:00:33,735 INFO [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 38836576615e75bf216da1fa8920c6a2 in 454ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:33,735 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:33,735 DEBUG [rs(jenkins-hbase4.apache.org,42493,1676836829827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 20:00:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 20:00:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 20:00:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42493,1676836829827' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 20:00:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,737 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:33,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42493,1676836829827' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 20:00:33,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681953ec[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:33,738 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 20:00:33,738 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 20:00:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 20:00:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 20:00:33,741 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42789,1676836829804' in zk 2023-02-19 20:00:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42493,1676836829827' in zk 2023-02-19 20:00:33,742 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,742 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:33,743 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:00:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:33,743 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 20:00:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,42789,1676836829804' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 20:00:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,42493,1676836829827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 20:00:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42493,1676836829827': 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42493,1676836829827' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:33,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42789,1676836829804': 2023-02-19 20:00:33,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42789,1676836829804' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:33,747 INFO [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-19 20:00:33,748 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:33,748 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:33,748 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,748 INFO [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:33,749 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,749 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:33,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,749 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:33,749 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,750 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:33,750 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:33,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,750 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,751 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:33,752 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:33,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:33,754 DEBUG [(jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-19 20:00:33,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:33,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:33,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:33,754 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:33,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,755 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,855 DEBUG [Listener at localhost/34071] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:33,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:33,860 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676836831959 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:33,861 DEBUG [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(239): region to add: 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=9a7e806d130de81480cad5ec53a91d9c as 9a7e806d130de81480cad5ec53a91d9c in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,861 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=569288db5ed13b1de225598cf6b75755 as 569288db5ed13b1de225598cf6b75755 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=bb95a71594e3fc2fea7f3667c254479b as bb95a71594e3fc2fea7f3667c254479b in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=3a1aec21a772dd38d30033115974e100 as 3a1aec21a772dd38d30033115974e100 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=d26c3fff501a01e1164f454407d045ad as d26c3fff501a01e1164f454407d045ad in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=aa88e7906e1842dca9a8e56745f8fdd6 as aa88e7906e1842dca9a8e56745f8fdd6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=7855d59ce5c1132f4c201b83d50b7a24 as 7855d59ce5c1132f4c201b83d50b7a24 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=38836576615e75bf216da1fa8920c6a2 as 38836576615e75bf216da1fa8920c6a2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=95329ac9746b431efe4c0bef12df7632 as 95329ac9746b431efe4c0bef12df7632 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,862 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(585): clone region=3bf13ef65ab32e662dce82729aa424d2 as 3bf13ef65ab32e662dce82729aa424d2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,863 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => aa88e7906e1842dca9a8e56745f8fdd6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 569288db5ed13b1de225598cf6b75755, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => bb95a71594e3fc2fea7f3667c254479b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3a1aec21a772dd38d30033115974e100, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d26c3fff501a01e1164f454407d045ad, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 38836576615e75bf216da1fa8920c6a2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9a7e806d130de81480cad5ec53a91d9c, NAME => 'testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,864 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 7855d59ce5c1132f4c201b83d50b7a24, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,887 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,887 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,887 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34a80e1c35be455c9faf1031b379c8a6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,887 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5896967539f447e8b9fb99399992207d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,895 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 459e0a0b29db49399400ab436cde49eb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,900 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1649f5fedf2541299c6fc875edfd5802 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,901 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 569288db5ed13b1de225598cf6b75755, disabling compactions & flushes 2023-02-19 20:00:33,901 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:33,901 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,901 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:33,901 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b0279816c774f0c9ebae069e1b258b9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,901 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. after waiting 0 ms 2023-02-19 20:00:33,902 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:33,902 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:33,902 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:33,903 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 95329ac9746b431efe4c0bef12df7632, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,910 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,910 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da5edb339a48498c85ba14d5e3f2f487 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,914 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing aa88e7906e1842dca9a8e56745f8fdd6, disabling compactions & flushes 2023-02-19 20:00:33,914 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:33,914 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:33,914 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. after waiting 0 ms 2023-02-19 20:00:33,914 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:33,914 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:33,914 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:33,915 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3bf13ef65ab32e662dce82729aa424d2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:33,916 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b919b8752f474de4ae01cfd08d13b66a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,918 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3a1aec21a772dd38d30033115974e100, disabling compactions & flushes 2023-02-19 20:00:33,918 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,918 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,918 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. after waiting 0 ms 2023-02-19 20:00:33,918 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,918 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:33,918 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,920 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a8445d1afc054ac592eadf9eaeda0a05 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9a7e806d130de81480cad5ec53a91d9c, disabling compactions & flushes 2023-02-19 20:00:33,920 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. after waiting 0 ms 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:33,920 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,920 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:33,921 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing bb95a71594e3fc2fea7f3667c254479b, disabling compactions & flushes 2023-02-19 20:00:33,921 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:33,921 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:33,921 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. after waiting 0 ms 2023-02-19 20:00:33,921 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:33,921 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:33,921 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:33,922 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 138094fe31d5445dbd4794fc2597f744 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,924 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3a24f3f28037491783adbb2549953dfa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,924 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,924 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1730b76f4baa49c1a064d643537dd816 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,925 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d26c3fff501a01e1164f454407d045ad, disabling compactions & flushes 2023-02-19 20:00:33,925 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:33,925 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:33,925 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. after waiting 0 ms 2023-02-19 20:00:33,925 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:33,925 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:33,925 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:33,926 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:33,926 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0752bb09c5474a2cb498f71e24019d8d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,927 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 7855d59ce5c1132f4c201b83d50b7a24, disabling compactions & flushes 2023-02-19 20:00:33,927 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,927 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d1590f7638aa4e3e8d41923c6da99c1d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,927 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,927 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. after waiting 0 ms 2023-02-19 20:00:33,927 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,927 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:33,927 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:33,928 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 265ffcfa0d974e3caf4c4b73944011b4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:33,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 95329ac9746b431efe4c0bef12df7632, disabling compactions & flushes 2023-02-19 20:00:33,929 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:33,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:33,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. after waiting 0 ms 2023-02-19 20:00:33,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:33,929 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:33,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:33,930 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3bf13ef65ab32e662dce82729aa424d2, disabling compactions & flushes 2023-02-19 20:00:33,930 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:33,930 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:33,930 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. after waiting 0 ms 2023-02-19 20:00:33,930 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:33,930 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:33,930 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:34,304 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:34,304 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0abfa793796a4bcabacab0b2761db909 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:34,306 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f0686e741f0441c4ad7b94afc1c847ba from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:34,308 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 38836576615e75bf216da1fa8920c6a2, disabling compactions & flushes 2023-02-19 20:00:34,308 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,308 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,308 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. after waiting 0 ms 2023-02-19 20:00:34,308 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,308 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,308 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:34,309 INFO [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676836831959 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:34,309 DEBUG [Listener at localhost/34071] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:34,309 DEBUG [Listener at localhost/34071] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af 2023-02-19 20:00:34,309 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:34,310 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:34,310 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-19 20:00:34,311 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------38836576615e75bf216da1fa8920c6a2/ 2023-02-19 20:00:34,311 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,311 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,311 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=38836576615e75bf216da1fa8920c6a2-0abfa793796a4bcabacab0b2761db909 2023-02-19 20:00:34,311 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,312 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=38836576615e75bf216da1fa8920c6a2-f0686e741f0441c4ad7b94afc1c847ba 2023-02-19 20:00:34,312 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------3a1aec21a772dd38d30033115974e100/ 2023-02-19 20:00:34,312 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,312 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,312 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3a1aec21a772dd38d30033115974e100-0b0279816c774f0c9ebae069e1b258b9 2023-02-19 20:00:34,312 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,313 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3a1aec21a772dd38d30033115974e100-b919b8752f474de4ae01cfd08d13b66a 2023-02-19 20:00:34,313 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------3bf13ef65ab32e662dce82729aa424d2/ 2023-02-19 20:00:34,313 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,313 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,313 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3bf13ef65ab32e662dce82729aa424d2-0752bb09c5474a2cb498f71e24019d8d 2023-02-19 20:00:34,314 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,314 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3bf13ef65ab32e662dce82729aa424d2-265ffcfa0d974e3caf4c4b73944011b4 2023-02-19 20:00:34,314 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------569288db5ed13b1de225598cf6b75755/ 2023-02-19 20:00:34,314 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,314 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,315 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=569288db5ed13b1de225598cf6b75755-34a80e1c35be455c9faf1031b379c8a6 2023-02-19 20:00:34,315 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,315 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=569288db5ed13b1de225598cf6b75755-459e0a0b29db49399400ab436cde49eb 2023-02-19 20:00:34,315 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------7855d59ce5c1132f4c201b83d50b7a24/ 2023-02-19 20:00:34,315 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,315 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,316 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7855d59ce5c1132f4c201b83d50b7a24-a8445d1afc054ac592eadf9eaeda0a05 2023-02-19 20:00:34,316 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,316 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7855d59ce5c1132f4c201b83d50b7a24-3a24f3f28037491783adbb2549953dfa 2023-02-19 20:00:34,316 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------95329ac9746b431efe4c0bef12df7632/ 2023-02-19 20:00:34,317 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,317 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,317 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=95329ac9746b431efe4c0bef12df7632-1730b76f4baa49c1a064d643537dd816 2023-02-19 20:00:34,317 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,317 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=95329ac9746b431efe4c0bef12df7632-d1590f7638aa4e3e8d41923c6da99c1d 2023-02-19 20:00:34,317 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------9a7e806d130de81480cad5ec53a91d9c/ 2023-02-19 20:00:34,318 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,318 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------aa88e7906e1842dca9a8e56745f8fdd6/ 2023-02-19 20:00:34,318 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,318 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,318 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=aa88e7906e1842dca9a8e56745f8fdd6-5896967539f447e8b9fb99399992207d 2023-02-19 20:00:34,319 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,319 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=aa88e7906e1842dca9a8e56745f8fdd6-1649f5fedf2541299c6fc875edfd5802 2023-02-19 20:00:34,319 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------bb95a71594e3fc2fea7f3667c254479b/ 2023-02-19 20:00:34,319 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,319 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |----------d26c3fff501a01e1164f454407d045ad/ 2023-02-19 20:00:34,319 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:34,320 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:34,320 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d26c3fff501a01e1164f454407d045ad-da5edb339a48498c85ba14d5e3f2f487 2023-02-19 20:00:34,320 DEBUG [Listener at localhost/34071] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:34,320 DEBUG [Listener at localhost/34071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d26c3fff501a01e1164f454407d045ad-138094fe31d5445dbd4794fc2597f744 2023-02-19 20:00:34,323 INFO [Listener at localhost/34071] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 20:00:34,872 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:34,873 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:34,874 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:34,876 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:34,877 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1 2023-02-19 20:00:34,878 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bf13ef65ab32e662dce82729aa424d2 columnFamilyName f1 2023-02-19 20:00:34,882 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/testWithMockedMapReduceMultiRegion=3bf13ef65ab32e662dce82729aa424d2-0752bb09c5474a2cb498f71e24019d8d 2023-02-19 20:00:34,883 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(310): Store=3bf13ef65ab32e662dce82729aa424d2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,883 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:34,884 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2 2023-02-19 20:00:34,884 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bf13ef65ab32e662dce82729aa424d2 columnFamilyName f2 2023-02-19 20:00:34,888 DEBUG [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/testWithMockedMapReduceMultiRegion=3bf13ef65ab32e662dce82729aa424d2-265ffcfa0d974e3caf4c4b73944011b4 2023-02-19 20:00:34,888 INFO [StoreOpener-3bf13ef65ab32e662dce82729aa424d2-1] regionserver.HStore(310): Store=3bf13ef65ab32e662dce82729aa424d2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,888 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:34,889 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 3bf13ef65ab32e662dce82729aa424d2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67072314, jitterRate=-5.446374416351318E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:34,889 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:34,901 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 3bf13ef65ab32e662dce82729aa424d2, disabling compactions & flushes 2023-02-19 20:00:34,901 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:34,901 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:34,902 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. after waiting 0 ms 2023-02-19 20:00:34,902 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:34,902 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:34,903 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:34,903 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:34,903 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:34,905 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:34,908 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:34,909 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1 2023-02-19 20:00:34,909 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38836576615e75bf216da1fa8920c6a2 columnFamilyName f1 2023-02-19 20:00:34,914 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/testWithMockedMapReduceMultiRegion=38836576615e75bf216da1fa8920c6a2-0abfa793796a4bcabacab0b2761db909 2023-02-19 20:00:34,914 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(310): Store=38836576615e75bf216da1fa8920c6a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,914 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:34,915 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2 2023-02-19 20:00:34,915 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38836576615e75bf216da1fa8920c6a2 columnFamilyName f2 2023-02-19 20:00:34,920 DEBUG [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/testWithMockedMapReduceMultiRegion=38836576615e75bf216da1fa8920c6a2-f0686e741f0441c4ad7b94afc1c847ba 2023-02-19 20:00:34,920 INFO [StoreOpener-38836576615e75bf216da1fa8920c6a2-1] regionserver.HStore(310): Store=38836576615e75bf216da1fa8920c6a2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,920 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:34,920 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 38836576615e75bf216da1fa8920c6a2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72000324, jitterRate=0.07288843393325806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:34,920 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:34,929 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 38836576615e75bf216da1fa8920c6a2, disabling compactions & flushes 2023-02-19 20:00:34,930 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,930 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,930 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. after waiting 0 ms 2023-02-19 20:00:34,930 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,931 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:34,931 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:34,931 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:34,932 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:34,933 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:34,935 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:34,936 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1 2023-02-19 20:00:34,936 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa88e7906e1842dca9a8e56745f8fdd6 columnFamilyName f1 2023-02-19 20:00:34,940 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/testWithMockedMapReduceMultiRegion=aa88e7906e1842dca9a8e56745f8fdd6-5896967539f447e8b9fb99399992207d 2023-02-19 20:00:34,940 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(310): Store=aa88e7906e1842dca9a8e56745f8fdd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,940 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:34,941 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2 2023-02-19 20:00:34,941 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa88e7906e1842dca9a8e56745f8fdd6 columnFamilyName f2 2023-02-19 20:00:34,944 DEBUG [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/testWithMockedMapReduceMultiRegion=aa88e7906e1842dca9a8e56745f8fdd6-1649f5fedf2541299c6fc875edfd5802 2023-02-19 20:00:34,945 INFO [StoreOpener-aa88e7906e1842dca9a8e56745f8fdd6-1] regionserver.HStore(310): Store=aa88e7906e1842dca9a8e56745f8fdd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,945 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:34,945 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened aa88e7906e1842dca9a8e56745f8fdd6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63421682, jitterRate=-0.05494329333305359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:34,945 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:34,953 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing aa88e7906e1842dca9a8e56745f8fdd6, disabling compactions & flushes 2023-02-19 20:00:34,954 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:34,955 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:34,955 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. after waiting 0 ms 2023-02-19 20:00:34,955 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:34,955 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:34,956 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:34,956 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:34,956 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:34,958 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:34,959 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:34,960 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1 2023-02-19 20:00:34,961 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7855d59ce5c1132f4c201b83d50b7a24 columnFamilyName f1 2023-02-19 20:00:34,966 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/testWithMockedMapReduceMultiRegion=7855d59ce5c1132f4c201b83d50b7a24-a8445d1afc054ac592eadf9eaeda0a05 2023-02-19 20:00:34,966 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(310): Store=7855d59ce5c1132f4c201b83d50b7a24/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,966 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:34,967 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2 2023-02-19 20:00:34,967 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7855d59ce5c1132f4c201b83d50b7a24 columnFamilyName f2 2023-02-19 20:00:34,972 DEBUG [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/testWithMockedMapReduceMultiRegion=7855d59ce5c1132f4c201b83d50b7a24-3a24f3f28037491783adbb2549953dfa 2023-02-19 20:00:34,972 INFO [StoreOpener-7855d59ce5c1132f4c201b83d50b7a24-1] regionserver.HStore(310): Store=7855d59ce5c1132f4c201b83d50b7a24/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:34,972 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:34,972 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 7855d59ce5c1132f4c201b83d50b7a24; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61971136, jitterRate=-0.07655811309814453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:34,972 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:34,984 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 7855d59ce5c1132f4c201b83d50b7a24, disabling compactions & flushes 2023-02-19 20:00:34,984 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:34,984 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:34,984 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. after waiting 0 ms 2023-02-19 20:00:34,984 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:34,985 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:34,985 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:34,986 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:34,986 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:34,992 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:34,996 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:34,997 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1 2023-02-19 20:00:34,998 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 569288db5ed13b1de225598cf6b75755 columnFamilyName f1 2023-02-19 20:00:35,020 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/testWithMockedMapReduceMultiRegion=569288db5ed13b1de225598cf6b75755-34a80e1c35be455c9faf1031b379c8a6 2023-02-19 20:00:35,020 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(310): Store=569288db5ed13b1de225598cf6b75755/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,021 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:35,022 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2 2023-02-19 20:00:35,023 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 569288db5ed13b1de225598cf6b75755 columnFamilyName f2 2023-02-19 20:00:35,045 DEBUG [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/testWithMockedMapReduceMultiRegion=569288db5ed13b1de225598cf6b75755-459e0a0b29db49399400ab436cde49eb 2023-02-19 20:00:35,046 INFO [StoreOpener-569288db5ed13b1de225598cf6b75755-1] regionserver.HStore(310): Store=569288db5ed13b1de225598cf6b75755/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,046 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:35,046 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 569288db5ed13b1de225598cf6b75755; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64903470, jitterRate=-0.03286293148994446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:35,046 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:35,066 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 569288db5ed13b1de225598cf6b75755, disabling compactions & flushes 2023-02-19 20:00:35,066 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,066 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,066 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. after waiting 0 ms 2023-02-19 20:00:35,066 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,070 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,070 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:35,071 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:35,072 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:35,079 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:35,083 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:35,084 DEBUG [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f1 2023-02-19 20:00:35,085 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a7e806d130de81480cad5ec53a91d9c columnFamilyName f1 2023-02-19 20:00:35,085 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(310): Store=9a7e806d130de81480cad5ec53a91d9c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,085 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:35,087 DEBUG [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f2 2023-02-19 20:00:35,087 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a7e806d130de81480cad5ec53a91d9c columnFamilyName f2 2023-02-19 20:00:35,087 INFO [StoreOpener-9a7e806d130de81480cad5ec53a91d9c-1] regionserver.HStore(310): Store=9a7e806d130de81480cad5ec53a91d9c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,088 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:35,088 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 9a7e806d130de81480cad5ec53a91d9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69497476, jitterRate=0.03559309244155884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:35,088 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:35,088 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 9a7e806d130de81480cad5ec53a91d9c, disabling compactions & flushes 2023-02-19 20:00:35,088 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,088 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,088 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. after waiting 0 ms 2023-02-19 20:00:35,088 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,088 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,089 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:35,089 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:35,089 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:35,092 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:35,097 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:35,097 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1 2023-02-19 20:00:35,098 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95329ac9746b431efe4c0bef12df7632 columnFamilyName f1 2023-02-19 20:00:35,106 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/testWithMockedMapReduceMultiRegion=95329ac9746b431efe4c0bef12df7632-1730b76f4baa49c1a064d643537dd816 2023-02-19 20:00:35,106 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(310): Store=95329ac9746b431efe4c0bef12df7632/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,106 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:35,107 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2 2023-02-19 20:00:35,107 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95329ac9746b431efe4c0bef12df7632 columnFamilyName f2 2023-02-19 20:00:35,111 DEBUG [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/testWithMockedMapReduceMultiRegion=95329ac9746b431efe4c0bef12df7632-d1590f7638aa4e3e8d41923c6da99c1d 2023-02-19 20:00:35,112 INFO [StoreOpener-95329ac9746b431efe4c0bef12df7632-1] regionserver.HStore(310): Store=95329ac9746b431efe4c0bef12df7632/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,112 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:35,112 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 95329ac9746b431efe4c0bef12df7632; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65287847, jitterRate=-0.027135267853736877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:35,112 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:35,121 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 95329ac9746b431efe4c0bef12df7632, disabling compactions & flushes 2023-02-19 20:00:35,121 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,121 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,121 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. after waiting 0 ms 2023-02-19 20:00:35,121 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,122 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,122 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:35,123 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:35,123 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:35,125 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:35,129 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:35,130 DEBUG [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f1 2023-02-19 20:00:35,130 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb95a71594e3fc2fea7f3667c254479b columnFamilyName f1 2023-02-19 20:00:35,131 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(310): Store=bb95a71594e3fc2fea7f3667c254479b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,131 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:35,132 DEBUG [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f2 2023-02-19 20:00:35,132 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb95a71594e3fc2fea7f3667c254479b columnFamilyName f2 2023-02-19 20:00:35,132 INFO [StoreOpener-bb95a71594e3fc2fea7f3667c254479b-1] regionserver.HStore(310): Store=bb95a71594e3fc2fea7f3667c254479b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,133 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:35,133 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened bb95a71594e3fc2fea7f3667c254479b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62412990, jitterRate=-0.06997397541999817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:35,133 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:35,133 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing bb95a71594e3fc2fea7f3667c254479b, disabling compactions & flushes 2023-02-19 20:00:35,133 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,133 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,133 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. after waiting 0 ms 2023-02-19 20:00:35,133 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,133 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,134 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:35,134 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:35,134 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:35,135 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:35,137 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:35,137 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1 2023-02-19 20:00:35,138 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1aec21a772dd38d30033115974e100 columnFamilyName f1 2023-02-19 20:00:35,142 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/testWithMockedMapReduceMultiRegion=3a1aec21a772dd38d30033115974e100-0b0279816c774f0c9ebae069e1b258b9 2023-02-19 20:00:35,142 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(310): Store=3a1aec21a772dd38d30033115974e100/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,142 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:35,142 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2 2023-02-19 20:00:35,143 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1aec21a772dd38d30033115974e100 columnFamilyName f2 2023-02-19 20:00:35,147 DEBUG [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/testWithMockedMapReduceMultiRegion=3a1aec21a772dd38d30033115974e100-b919b8752f474de4ae01cfd08d13b66a 2023-02-19 20:00:35,147 INFO [StoreOpener-3a1aec21a772dd38d30033115974e100-1] regionserver.HStore(310): Store=3a1aec21a772dd38d30033115974e100/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,147 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:35,147 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened 3a1aec21a772dd38d30033115974e100; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62931675, jitterRate=-0.0622449666261673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:35,147 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:35,157 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing 3a1aec21a772dd38d30033115974e100, disabling compactions & flushes 2023-02-19 20:00:35,157 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,158 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,158 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. after waiting 0 ms 2023-02-19 20:00:35,158 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,160 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,160 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:35,160 DEBUG [Listener at localhost/34071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:35,160 INFO [Listener at localhost/34071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:35,162 DEBUG [Listener at localhost/34071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:35,164 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:35,164 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1 2023-02-19 20:00:35,165 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26c3fff501a01e1164f454407d045ad columnFamilyName f1 2023-02-19 20:00:35,169 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/testWithMockedMapReduceMultiRegion=d26c3fff501a01e1164f454407d045ad-da5edb339a48498c85ba14d5e3f2f487 2023-02-19 20:00:35,169 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(310): Store=d26c3fff501a01e1164f454407d045ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,169 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:35,169 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2 2023-02-19 20:00:35,170 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26c3fff501a01e1164f454407d045ad columnFamilyName f2 2023-02-19 20:00:35,174 DEBUG [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(539): loaded hdfs://localhost:37583/user/jenkins/test-data/d5a74528-69a6-7371-1423-038511dae579/testWithMockedMapReduceMultiRegion/abe206d6-d94e-4d55-8e19-84a9197ef3af/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/testWithMockedMapReduceMultiRegion=d26c3fff501a01e1164f454407d045ad-138094fe31d5445dbd4794fc2597f744 2023-02-19 20:00:35,174 INFO [StoreOpener-d26c3fff501a01e1164f454407d045ad-1] regionserver.HStore(310): Store=d26c3fff501a01e1164f454407d045ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:35,174 DEBUG [Listener at localhost/34071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:35,174 INFO [Listener at localhost/34071] regionserver.HRegion(1071): Opened d26c3fff501a01e1164f454407d045ad; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64622383, jitterRate=-0.037051454186439514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:35,174 DEBUG [Listener at localhost/34071] regionserver.HRegion(964): Region open journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:35,184 DEBUG [Listener at localhost/34071] regionserver.HRegion(1603): Closing d26c3fff501a01e1164f454407d045ad, disabling compactions & flushes 2023-02-19 20:00:35,184 INFO [Listener at localhost/34071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,184 DEBUG [Listener at localhost/34071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,184 DEBUG [Listener at localhost/34071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. after waiting 0 ms 2023-02-19 20:00:35,184 DEBUG [Listener at localhost/34071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,185 INFO [Listener at localhost/34071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,185 DEBUG [Listener at localhost/34071] regionserver.HRegion(1557): Region close journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:35,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-19 20:00:35,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,192 INFO [Listener at localhost/34071] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,196 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836835196"}]},"ts":"1676836835196"} 2023-02-19 20:00:35,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:35,197 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-19 20:00:35,200 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-19 20:00:35,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, UNASSIGN}] 2023-02-19 20:00:35,202 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, UNASSIGN 2023-02-19 20:00:35,203 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, UNASSIGN 2023-02-19 20:00:35,203 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, UNASSIGN 2023-02-19 20:00:35,203 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, UNASSIGN 2023-02-19 20:00:35,203 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, UNASSIGN 2023-02-19 20:00:35,203 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d26c3fff501a01e1164f454407d045ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,203 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=3a1aec21a772dd38d30033115974e100, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,203 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835203"}]},"ts":"1676836835203"} 2023-02-19 20:00:35,203 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=bb95a71594e3fc2fea7f3667c254479b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,203 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9a7e806d130de81480cad5ec53a91d9c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=569288db5ed13b1de225598cf6b75755, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,203 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836835203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835203"}]},"ts":"1676836835203"} 2023-02-19 20:00:35,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835203"}]},"ts":"1676836835203"} 2023-02-19 20:00:35,203 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835203"}]},"ts":"1676836835203"} 2023-02-19 20:00:35,203 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836835203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835203"}]},"ts":"1676836835203"} 2023-02-19 20:00:35,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure d26c3fff501a01e1164f454407d045ad, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:35,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 9a7e806d130de81480cad5ec53a91d9c, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:35,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure 569288db5ed13b1de225598cf6b75755, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:35,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure bb95a71594e3fc2fea7f3667c254479b, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:35,207 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, UNASSIGN 2023-02-19 20:00:35,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=35, state=RUNNABLE; CloseRegionProcedure 3a1aec21a772dd38d30033115974e100, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:35,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, UNASSIGN 2023-02-19 20:00:35,207 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3bf13ef65ab32e662dce82729aa424d2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,207 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835207"}]},"ts":"1676836835207"} 2023-02-19 20:00:35,208 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=aa88e7906e1842dca9a8e56745f8fdd6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,208 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835208"}]},"ts":"1676836835208"} 2023-02-19 20:00:35,208 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, UNASSIGN 2023-02-19 20:00:35,208 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, UNASSIGN 2023-02-19 20:00:35,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=38836576615e75bf216da1fa8920c6a2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=40, state=RUNNABLE; CloseRegionProcedure 3bf13ef65ab32e662dce82729aa424d2, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:35,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835208"}]},"ts":"1676836835208"} 2023-02-19 20:00:35,209 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, UNASSIGN 2023-02-19 20:00:35,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=95329ac9746b431efe4c0bef12df7632, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=39, state=RUNNABLE; CloseRegionProcedure aa88e7906e1842dca9a8e56745f8fdd6, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:35,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835209"}]},"ts":"1676836835209"} 2023-02-19 20:00:35,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7855d59ce5c1132f4c201b83d50b7a24, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836835210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836835210"}]},"ts":"1676836835210"} 2023-02-19 20:00:35,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=38, state=RUNNABLE; CloseRegionProcedure 38836576615e75bf216da1fa8920c6a2, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:35,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=37, state=RUNNABLE; CloseRegionProcedure 95329ac9746b431efe4c0bef12df7632, server=jenkins-hbase4.apache.org,42493,1676836829827}] 2023-02-19 20:00:35,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure 7855d59ce5c1132f4c201b83d50b7a24, server=jenkins-hbase4.apache.org,42789,1676836829804}] 2023-02-19 20:00:35,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:35,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:35,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d26c3fff501a01e1164f454407d045ad, disabling compactions & flushes 2023-02-19 20:00:35,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. after waiting 0 ms 2023-02-19 20:00:35,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:35,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3a1aec21a772dd38d30033115974e100, disabling compactions & flushes 2023-02-19 20:00:35,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. after waiting 0 ms 2023-02-19 20:00:35,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad. 2023-02-19 20:00:35,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d26c3fff501a01e1164f454407d045ad: 2023-02-19 20:00:35,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:35,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:35,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aa88e7906e1842dca9a8e56745f8fdd6, disabling compactions & flushes 2023-02-19 20:00:35,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:35,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:35,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. after waiting 0 ms 2023-02-19 20:00:35,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:35,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=d26c3fff501a01e1164f454407d045ad, regionState=CLOSED 2023-02-19 20:00:35,367 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835367"}]},"ts":"1676836835367"} 2023-02-19 20:00:35,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-19 20:00:35,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure d26c3fff501a01e1164f454407d045ad, server=jenkins-hbase4.apache.org,42789,1676836829804 in 165 msec 2023-02-19 20:00:35,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d26c3fff501a01e1164f454407d045ad, UNASSIGN in 170 msec 2023-02-19 20:00:35,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100. 2023-02-19 20:00:35,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3a1aec21a772dd38d30033115974e100: 2023-02-19 20:00:35,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:35,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:35,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 95329ac9746b431efe4c0bef12df7632, disabling compactions & flushes 2023-02-19 20:00:35,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. after waiting 0 ms 2023-02-19 20:00:35,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,374 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=3a1aec21a772dd38d30033115974e100, regionState=CLOSED 2023-02-19 20:00:35,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,375 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835374"}]},"ts":"1676836835374"} 2023-02-19 20:00:35,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6. 2023-02-19 20:00:35,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aa88e7906e1842dca9a8e56745f8fdd6: 2023-02-19 20:00:35,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:35,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:35,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3bf13ef65ab32e662dce82729aa424d2, disabling compactions & flushes 2023-02-19 20:00:35,377 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=aa88e7906e1842dca9a8e56745f8fdd6, regionState=CLOSED 2023-02-19 20:00:35,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:35,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:35,377 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835377"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835377"}]},"ts":"1676836835377"} 2023-02-19 20:00:35,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. after waiting 0 ms 2023-02-19 20:00:35,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:35,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=35 2023-02-19 20:00:35,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=35, state=SUCCESS; CloseRegionProcedure 3a1aec21a772dd38d30033115974e100, server=jenkins-hbase4.apache.org,42493,1676836829827 in 169 msec 2023-02-19 20:00:35,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a1aec21a772dd38d30033115974e100, UNASSIGN in 177 msec 2023-02-19 20:00:35,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=39 2023-02-19 20:00:35,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=39, state=SUCCESS; CloseRegionProcedure aa88e7906e1842dca9a8e56745f8fdd6, server=jenkins-hbase4.apache.org,42789,1676836829804 in 170 msec 2023-02-19 20:00:35,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632. 2023-02-19 20:00:35,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 95329ac9746b431efe4c0bef12df7632: 2023-02-19 20:00:35,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa88e7906e1842dca9a8e56745f8fdd6, UNASSIGN in 179 msec 2023-02-19 20:00:35,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:35,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:35,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 569288db5ed13b1de225598cf6b75755, disabling compactions & flushes 2023-02-19 20:00:35,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2. 2023-02-19 20:00:35,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3bf13ef65ab32e662dce82729aa424d2: 2023-02-19 20:00:35,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,383 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=95329ac9746b431efe4c0bef12df7632, regionState=CLOSED 2023-02-19 20:00:35,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. after waiting 0 ms 2023-02-19 20:00:35,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,383 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835383"}]},"ts":"1676836835383"} 2023-02-19 20:00:35,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:35,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:35,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7855d59ce5c1132f4c201b83d50b7a24, disabling compactions & flushes 2023-02-19 20:00:35,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:35,384 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3bf13ef65ab32e662dce82729aa424d2, regionState=CLOSED 2023-02-19 20:00:35,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:35,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. after waiting 0 ms 2023-02-19 20:00:35,384 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835384"}]},"ts":"1676836835384"} 2023-02-19 20:00:35,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:35,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=37 2023-02-19 20:00:35,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=37, state=SUCCESS; CloseRegionProcedure 95329ac9746b431efe4c0bef12df7632, server=jenkins-hbase4.apache.org,42493,1676836829827 in 173 msec 2023-02-19 20:00:35,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=95329ac9746b431efe4c0bef12df7632, UNASSIGN in 184 msec 2023-02-19 20:00:35,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=40 2023-02-19 20:00:35,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=40, state=SUCCESS; CloseRegionProcedure 3bf13ef65ab32e662dce82729aa424d2, server=jenkins-hbase4.apache.org,42789,1676836829804 in 177 msec 2023-02-19 20:00:35,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bf13ef65ab32e662dce82729aa424d2, UNASSIGN in 186 msec 2023-02-19 20:00:35,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755. 2023-02-19 20:00:35,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 569288db5ed13b1de225598cf6b75755: 2023-02-19 20:00:35,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24. 2023-02-19 20:00:35,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7855d59ce5c1132f4c201b83d50b7a24: 2023-02-19 20:00:35,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:35,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:35,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bb95a71594e3fc2fea7f3667c254479b, disabling compactions & flushes 2023-02-19 20:00:35,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. after waiting 0 ms 2023-02-19 20:00:35,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,400 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=569288db5ed13b1de225598cf6b75755, regionState=CLOSED 2023-02-19 20:00:35,400 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835399"}]},"ts":"1676836835399"} 2023-02-19 20:00:35,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:35,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:35,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9a7e806d130de81480cad5ec53a91d9c, disabling compactions & flushes 2023-02-19 20:00:35,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. after waiting 0 ms 2023-02-19 20:00:35,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,401 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7855d59ce5c1132f4c201b83d50b7a24, regionState=CLOSED 2023-02-19 20:00:35,402 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835401"}]},"ts":"1676836835401"} 2023-02-19 20:00:35,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-19 20:00:35,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure 569288db5ed13b1de225598cf6b75755, server=jenkins-hbase4.apache.org,42493,1676836829827 in 195 msec 2023-02-19 20:00:35,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-19 20:00:35,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=569288db5ed13b1de225598cf6b75755, UNASSIGN in 202 msec 2023-02-19 20:00:35,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure 7855d59ce5c1132f4c201b83d50b7a24, server=jenkins-hbase4.apache.org,42789,1676836829804 in 192 msec 2023-02-19 20:00:35,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 20:00:35,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 20:00:35,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7855d59ce5c1132f4c201b83d50b7a24, UNASSIGN in 204 msec 2023-02-19 20:00:35,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b. 2023-02-19 20:00:35,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bb95a71594e3fc2fea7f3667c254479b: 2023-02-19 20:00:35,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c. 2023-02-19 20:00:35,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9a7e806d130de81480cad5ec53a91d9c: 2023-02-19 20:00:35,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:35,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:35,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 38836576615e75bf216da1fa8920c6a2, disabling compactions & flushes 2023-02-19 20:00:35,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:35,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:35,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. after waiting 0 ms 2023-02-19 20:00:35,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:35,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:35,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2. 2023-02-19 20:00:35,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 38836576615e75bf216da1fa8920c6a2: 2023-02-19 20:00:35,418 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=bb95a71594e3fc2fea7f3667c254479b, regionState=CLOSED 2023-02-19 20:00:35,418 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836835418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835418"}]},"ts":"1676836835418"} 2023-02-19 20:00:35,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:35,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9a7e806d130de81480cad5ec53a91d9c, regionState=CLOSED 2023-02-19 20:00:35,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676836835419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835419"}]},"ts":"1676836835419"} 2023-02-19 20:00:35,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:35,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=38836576615e75bf216da1fa8920c6a2, regionState=CLOSED 2023-02-19 20:00:35,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676836835419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836835419"}]},"ts":"1676836835419"} 2023-02-19 20:00:35,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-19 20:00:35,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure bb95a71594e3fc2fea7f3667c254479b, server=jenkins-hbase4.apache.org,42493,1676836829827 in 213 msec 2023-02-19 20:00:35,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-19 20:00:35,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 9a7e806d130de81480cad5ec53a91d9c, server=jenkins-hbase4.apache.org,42789,1676836829804 in 215 msec 2023-02-19 20:00:35,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=38 2023-02-19 20:00:35,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=38, state=SUCCESS; CloseRegionProcedure 38836576615e75bf216da1fa8920c6a2, server=jenkins-hbase4.apache.org,42493,1676836829827 in 211 msec 2023-02-19 20:00:35,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb95a71594e3fc2fea7f3667c254479b, UNASSIGN in 220 msec 2023-02-19 20:00:35,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9a7e806d130de81480cad5ec53a91d9c, UNASSIGN in 221 msec 2023-02-19 20:00:35,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-19 20:00:35,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=38836576615e75bf216da1fa8920c6a2, UNASSIGN in 221 msec 2023-02-19 20:00:35,424 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836835423"}]},"ts":"1676836835423"} 2023-02-19 20:00:35,424 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-19 20:00:35,426 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-19 20:00:35,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 233 msec 2023-02-19 20:00:35,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 20:00:35,499 INFO [Listener at localhost/34071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-19 20:00:35,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 20:00:35,514 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:35,515 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:35,521 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/recovered.edits] 2023-02-19 20:00:35,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/recovered.edits] 2023-02-19 20:00:35,522 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/recovered.edits] 2023-02-19 20:00:35,523 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/recovered.edits] 2023-02-19 20:00:35,523 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/recovered.edits] 2023-02-19 20:00:35,523 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/recovered.edits] 2023-02-19 20:00:35,524 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/recovered.edits] 2023-02-19 20:00:35,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/recovered.edits] 2023-02-19 20:00:35,535 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/a8445d1afc054ac592eadf9eaeda0a05 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/a8445d1afc054ac592eadf9eaeda0a05 2023-02-19 20:00:35,536 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/34a80e1c35be455c9faf1031b379c8a6 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/34a80e1c35be455c9faf1031b379c8a6 2023-02-19 20:00:35,536 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/0752bb09c5474a2cb498f71e24019d8d to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/0752bb09c5474a2cb498f71e24019d8d 2023-02-19 20:00:35,538 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/1730b76f4baa49c1a064d643537dd816 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/1730b76f4baa49c1a064d643537dd816 2023-02-19 20:00:35,538 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/c984b64a3064475abaf0bd89b228298c to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f1/c984b64a3064475abaf0bd89b228298c 2023-02-19 20:00:35,538 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/0abfa793796a4bcabacab0b2761db909 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/0abfa793796a4bcabacab0b2761db909 2023-02-19 20:00:35,544 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/5896967539f447e8b9fb99399992207d to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/5896967539f447e8b9fb99399992207d 2023-02-19 20:00:35,545 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/ed39c4f58e3a4eecbe473675a033305f to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f1/ed39c4f58e3a4eecbe473675a033305f 2023-02-19 20:00:35,546 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/0b0279816c774f0c9ebae069e1b258b9 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/0b0279816c774f0c9ebae069e1b258b9 2023-02-19 20:00:35,547 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/366cb1326b3d41619554623178d637a2 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f1/366cb1326b3d41619554623178d637a2 2023-02-19 20:00:35,547 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/19de56152bbd4ac6a06a47802dfb5063 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f1/19de56152bbd4ac6a06a47802dfb5063 2023-02-19 20:00:35,548 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/bc206c48cdbd4874b85752e0fe722d9c to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f1/bc206c48cdbd4874b85752e0fe722d9c 2023-02-19 20:00:35,548 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/fb048b1003f24a099010a0d27454951a to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f1/fb048b1003f24a099010a0d27454951a 2023-02-19 20:00:35,548 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/973579db463d428c87c7aad19eac1ec0 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f1/973579db463d428c87c7aad19eac1ec0 2023-02-19 20:00:35,549 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/recovered.edits/6.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c/recovered.edits/6.seqid 2023-02-19 20:00:35,550 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/9a7e806d130de81480cad5ec53a91d9c 2023-02-19 20:00:35,550 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:35,551 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/3a24f3f28037491783adbb2549953dfa to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/3a24f3f28037491783adbb2549953dfa 2023-02-19 20:00:35,553 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/d2f07a2ba6c84220b988c3ef1d774f4d to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/f2/d2f07a2ba6c84220b988c3ef1d774f4d 2023-02-19 20:00:35,554 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/0fd70b96c5644334aa5d51f09595d164 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/0fd70b96c5644334aa5d51f09595d164 2023-02-19 20:00:35,554 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/recovered.edits] 2023-02-19 20:00:35,555 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b79dc5a4a92343738ad00e7c9a950540 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b79dc5a4a92343738ad00e7c9a950540 2023-02-19 20:00:35,555 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/265ffcfa0d974e3caf4c4b73944011b4 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/265ffcfa0d974e3caf4c4b73944011b4 2023-02-19 20:00:35,555 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/837eb68ecdb34848bc32188d706e9b4d to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/837eb68ecdb34848bc32188d706e9b4d 2023-02-19 20:00:35,555 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/87b94c2e10ec4ea4b9577d0efa169ba7 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/87b94c2e10ec4ea4b9577d0efa169ba7 2023-02-19 20:00:35,556 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/1649f5fedf2541299c6fc875edfd5802 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/1649f5fedf2541299c6fc875edfd5802 2023-02-19 20:00:35,557 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/459e0a0b29db49399400ab436cde49eb to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/f2/459e0a0b29db49399400ab436cde49eb 2023-02-19 20:00:35,558 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/47488252c3a645bca213a32e982be57f to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/f2/47488252c3a645bca213a32e982be57f 2023-02-19 20:00:35,558 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/ca3d89a127374ee0acf5a0ba03fb3c8d to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/f2/ca3d89a127374ee0acf5a0ba03fb3c8d 2023-02-19 20:00:35,558 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/f0686e741f0441c4ad7b94afc1c847ba to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/f2/f0686e741f0441c4ad7b94afc1c847ba 2023-02-19 20:00:35,558 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b919b8752f474de4ae01cfd08d13b66a to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/f2/b919b8752f474de4ae01cfd08d13b66a 2023-02-19 20:00:35,559 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24/recovered.edits/12.seqid 2023-02-19 20:00:35,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/d1590f7638aa4e3e8d41923c6da99c1d to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/f2/d1590f7638aa4e3e8d41923c6da99c1d 2023-02-19 20:00:35,560 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/7855d59ce5c1132f4c201b83d50b7a24 2023-02-19 20:00:35,560 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:35,563 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/69e5dbbe5d094772b5b54dfdf7ce829f to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/69e5dbbe5d094772b5b54dfdf7ce829f 2023-02-19 20:00:35,564 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f1, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/f2, FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/recovered.edits] 2023-02-19 20:00:35,564 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755/recovered.edits/12.seqid 2023-02-19 20:00:35,564 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100/recovered.edits/12.seqid 2023-02-19 20:00:35,565 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2/recovered.edits/12.seqid 2023-02-19 20:00:35,565 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6/recovered.edits/12.seqid 2023-02-19 20:00:35,565 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/da5edb339a48498c85ba14d5e3f2f487 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f1/da5edb339a48498c85ba14d5e3f2f487 2023-02-19 20:00:35,565 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/569288db5ed13b1de225598cf6b75755 2023-02-19 20:00:35,565 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a1aec21a772dd38d30033115974e100 2023-02-19 20:00:35,566 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2/recovered.edits/12.seqid 2023-02-19 20:00:35,566 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632/recovered.edits/12.seqid 2023-02-19 20:00:35,566 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bf13ef65ab32e662dce82729aa424d2 2023-02-19 20:00:35,566 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa88e7906e1842dca9a8e56745f8fdd6 2023-02-19 20:00:35,567 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/38836576615e75bf216da1fa8920c6a2 2023-02-19 20:00:35,567 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/95329ac9746b431efe4c0bef12df7632 2023-02-19 20:00:35,575 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/138094fe31d5445dbd4794fc2597f744 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/138094fe31d5445dbd4794fc2597f744 2023-02-19 20:00:35,576 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/a4dbc1d0fbd24f6893dd842fdd706037 to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/f2/a4dbc1d0fbd24f6893dd842fdd706037 2023-02-19 20:00:35,577 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/recovered.edits/6.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b/recovered.edits/6.seqid 2023-02-19 20:00:35,577 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb95a71594e3fc2fea7f3667c254479b 2023-02-19 20:00:35,579 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/recovered.edits/12.seqid to hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/archive/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad/recovered.edits/12.seqid 2023-02-19 20:00:35,580 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/.tmp/data/default/testWithMockedMapReduceMultiRegion/d26c3fff501a01e1164f454407d045ad 2023-02-19 20:00:35,580 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-19 20:00:35,582 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,585 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-19 20:00:35,587 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-19 20:00:35,588 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,588 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-19 20:00:35,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836835588"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-19 20:00:35,591 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9a7e806d130de81480cad5ec53a91d9c, NAME => 'testWithMockedMapReduceMultiRegion,,1676836831197.9a7e806d130de81480cad5ec53a91d9c.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 3a1aec21a772dd38d30033115974e100, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676836831197.3a1aec21a772dd38d30033115974e100.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 7855d59ce5c1132f4c201b83d50b7a24, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676836831197.7855d59ce5c1132f4c201b83d50b7a24.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 95329ac9746b431efe4c0bef12df7632, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676836831197.95329ac9746b431efe4c0bef12df7632.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 38836576615e75bf216da1fa8920c6a2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676836831197.38836576615e75bf216da1fa8920c6a2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => aa88e7906e1842dca9a8e56745f8fdd6, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676836831197.aa88e7906e1842dca9a8e56745f8fdd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 3bf13ef65ab32e662dce82729aa424d2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676836831197.3bf13ef65ab32e662dce82729aa424d2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 569288db5ed13b1de225598cf6b75755, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676836831197.569288db5ed13b1de225598cf6b75755.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => d26c3fff501a01e1164f454407d045ad, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676836831197.d26c3fff501a01e1164f454407d045ad.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => bb95a71594e3fc2fea7f3667c254479b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676836831197.bb95a71594e3fc2fea7f3667c254479b.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-19 20:00:35,591 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-19 20:00:35,591 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676836835591"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:35,599 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-19 20:00:35,601 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 20:00:35,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 101 msec 2023-02-19 20:00:35,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34205] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 20:00:35,606 INFO [Listener at localhost/34071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-19 20:00:35,606 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:35,606 INFO [Listener at localhost/34071] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:35,606 DEBUG [Listener at localhost/34071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f37f8b0 to 127.0.0.1:64895 2023-02-19 20:00:35,606 DEBUG [Listener at localhost/34071] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,606 DEBUG [Listener at localhost/34071] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:35,606 DEBUG [Listener at localhost/34071] util.JVMClusterUtil(257): Found active master hash=288122875, stopped=false 2023-02-19 20:00:35,606 INFO [Listener at localhost/34071] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:35,614 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:35,614 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:35,614 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:35,614 INFO [Listener at localhost/34071] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:35,614 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:35,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:35,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:35,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:35,616 DEBUG [Listener at localhost/34071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x423dc86f to 127.0.0.1:64895 2023-02-19 20:00:35,616 DEBUG [Listener at localhost/34071] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,616 INFO [Listener at localhost/34071] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42789,1676836829804' ***** 2023-02-19 20:00:35,616 INFO [Listener at localhost/34071] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:35,616 INFO [Listener at localhost/34071] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42493,1676836829827' ***** 2023-02-19 20:00:35,616 INFO [Listener at localhost/34071] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:35,617 INFO [RS:1;jenkins-hbase4:42493] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:35,617 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:35,617 INFO [RS:0;jenkins-hbase4:42789] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:35,618 INFO [RS:0;jenkins-hbase4:42789] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:35,618 INFO [RS:0;jenkins-hbase4:42789] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:35,618 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(3304): Received CLOSE for cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:35,618 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,618 DEBUG [RS:0;jenkins-hbase4:42789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32533615 to 127.0.0.1:64895 2023-02-19 20:00:35,618 INFO [RS:1;jenkins-hbase4:42493] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:35,619 DEBUG [RS:0;jenkins-hbase4:42789] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,619 INFO [RS:0;jenkins-hbase4:42789] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:35,619 INFO [RS:0;jenkins-hbase4:42789] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:35,619 INFO [RS:0;jenkins-hbase4:42789] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:35,619 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:35,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb46ec196d5244590fb6075e421c4535, disabling compactions & flushes 2023-02-19 20:00:35,620 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 20:00:35,618 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:35,620 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, cb46ec196d5244590fb6075e421c4535=hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535.} 2023-02-19 20:00:35,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:35,623 DEBUG [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1505): Waiting on 1588230740, cb46ec196d5244590fb6075e421c4535 2023-02-19 20:00:35,619 INFO [RS:1;jenkins-hbase4:42493] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:35,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:35,622 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:35,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. after waiting 0 ms 2023-02-19 20:00:35,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:35,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:35,623 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cb46ec196d5244590fb6075e421c4535 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:35,623 DEBUG [RS:1;jenkins-hbase4:42493] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7de674e9 to 127.0.0.1:64895 2023-02-19 20:00:35,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:35,623 DEBUG [RS:1;jenkins-hbase4:42493] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:35,623 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42493,1676836829827; all regions closed. 2023-02-19 20:00:35,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:35,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-19 20:00:35,629 DEBUG [RS:1;jenkins-hbase4:42493] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/oldWALs 2023-02-19 20:00:35,629 INFO [RS:1;jenkins-hbase4:42493] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42493%2C1676836829827:(num 1676836831190) 2023-02-19 20:00:35,629 DEBUG [RS:1;jenkins-hbase4:42493] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,629 INFO [RS:1;jenkins-hbase4:42493] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:35,629 INFO [RS:1;jenkins-hbase4:42493] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:35,629 INFO [RS:1;jenkins-hbase4:42493] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:35,629 INFO [RS:1;jenkins-hbase4:42493] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:35,629 INFO [RS:1;jenkins-hbase4:42493] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:35,630 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:35,631 INFO [RS:1;jenkins-hbase4:42493] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42493 2023-02-19 20:00:35,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/.tmp/info/9d77c6d54b7d4f40b8ae214e1aedb015 2023-02-19 20:00:35,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/.tmp/info/809cd3adb21d45deb0c854b60bfe3433 2023-02-19 20:00:35,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/.tmp/info/9d77c6d54b7d4f40b8ae214e1aedb015 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/info/9d77c6d54b7d4f40b8ae214e1aedb015 2023-02-19 20:00:35,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 809cd3adb21d45deb0c854b60bfe3433 2023-02-19 20:00:35,668 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:35,668 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:35,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/info/9d77c6d54b7d4f40b8ae214e1aedb015, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:35,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cb46ec196d5244590fb6075e421c4535 in 48ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:35,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/namespace/cb46ec196d5244590fb6075e421c4535/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:35,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/.tmp/rep_barrier/85acc8a4f4c34870bda12e448908b6ed 2023-02-19 20:00:35,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:35,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb46ec196d5244590fb6075e421c4535: 2023-02-19 20:00:35,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836830541.cb46ec196d5244590fb6075e421c4535. 2023-02-19 20:00:35,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85acc8a4f4c34870bda12e448908b6ed 2023-02-19 20:00:35,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/.tmp/table/1df6af792da6459c82ef7c5949b93ce6 2023-02-19 20:00:35,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1df6af792da6459c82ef7c5949b93ce6 2023-02-19 20:00:35,699 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/.tmp/info/809cd3adb21d45deb0c854b60bfe3433 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/info/809cd3adb21d45deb0c854b60bfe3433 2023-02-19 20:00:35,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 809cd3adb21d45deb0c854b60bfe3433 2023-02-19 20:00:35,702 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/info/809cd3adb21d45deb0c854b60bfe3433, entries=30, sequenceid=57, filesize=8.3 K 2023-02-19 20:00:35,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/.tmp/rep_barrier/85acc8a4f4c34870bda12e448908b6ed as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/rep_barrier/85acc8a4f4c34870bda12e448908b6ed 2023-02-19 20:00:35,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85acc8a4f4c34870bda12e448908b6ed 2023-02-19 20:00:35,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/rep_barrier/85acc8a4f4c34870bda12e448908b6ed, entries=10, sequenceid=57, filesize=6.1 K 2023-02-19 20:00:35,708 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/.tmp/table/1df6af792da6459c82ef7c5949b93ce6 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/table/1df6af792da6459c82ef7c5949b93ce6 2023-02-19 20:00:35,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1df6af792da6459c82ef7c5949b93ce6 2023-02-19 20:00:35,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/table/1df6af792da6459c82ef7c5949b93ce6, entries=13, sequenceid=57, filesize=6.1 K 2023-02-19 20:00:35,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 90ms, sequenceid=57, compaction requested=false 2023-02-19 20:00:35,721 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,721 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:35,721 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42493,1676836829827 2023-02-19 20:00:35,721 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:35,721 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:35,724 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1707c3bc rejected from java.util.concurrent.ThreadPoolExecutor@13384584[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:35,724 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42493,1676836829827] 2023-02-19 20:00:35,724 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42493,1676836829827; numProcessing=1 2023-02-19 20:00:35,726 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42493,1676836829827 already deleted, retry=false 2023-02-19 20:00:35,726 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42493,1676836829827 expired; onlineServers=1 2023-02-19 20:00:35,738 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-19 20:00:35,738 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:35,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:35,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:35,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:35,823 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42789,1676836829804; all regions closed. 2023-02-19 20:00:35,829 DEBUG [RS:0;jenkins-hbase4:42789] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/oldWALs 2023-02-19 20:00:35,829 INFO [RS:0;jenkins-hbase4:42789] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42789%2C1676836829804.meta:.meta(num 1676836830487) 2023-02-19 20:00:35,833 DEBUG [RS:0;jenkins-hbase4:42789] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/oldWALs 2023-02-19 20:00:35,833 INFO [RS:0;jenkins-hbase4:42789] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42789%2C1676836829804:(num 1676836830894) 2023-02-19 20:00:35,833 DEBUG [RS:0;jenkins-hbase4:42789] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,833 INFO [RS:0;jenkins-hbase4:42789] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:35,833 INFO [RS:0;jenkins-hbase4:42789] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:35,833 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:35,834 INFO [RS:0;jenkins-hbase4:42789] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42789 2023-02-19 20:00:35,835 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42789,1676836829804 2023-02-19 20:00:35,835 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:35,836 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34d444cb rejected from java.util.concurrent.ThreadPoolExecutor@30ebc689[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:35,837 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42789,1676836829804] 2023-02-19 20:00:35,837 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42789,1676836829804; numProcessing=2 2023-02-19 20:00:35,838 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42789,1676836829804 already deleted, retry=false 2023-02-19 20:00:35,838 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42789,1676836829804 expired; onlineServers=0 2023-02-19 20:00:35,839 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34205,1676836829761' ***** 2023-02-19 20:00:35,839 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:35,839 DEBUG [M:0;jenkins-hbase4:34205] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1513e106, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:35,839 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34205,1676836829761 2023-02-19 20:00:35,839 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34205,1676836829761; all regions closed. 2023-02-19 20:00:35,839 DEBUG [M:0;jenkins-hbase4:34205] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:35,839 DEBUG [M:0;jenkins-hbase4:34205] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:35,839 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:35,839 DEBUG [M:0;jenkins-hbase4:34205] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:35,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836830084] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836830084,5,FailOnTimeoutGroup] 2023-02-19 20:00:35,840 INFO [M:0;jenkins-hbase4:34205] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:35,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836830084] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836830084,5,FailOnTimeoutGroup] 2023-02-19 20:00:35,840 INFO [M:0;jenkins-hbase4:34205] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:35,841 INFO [M:0;jenkins-hbase4:34205] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:35,841 DEBUG [M:0;jenkins-hbase4:34205] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:35,841 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:35,841 INFO [M:0;jenkins-hbase4:34205] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:35,841 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:35,841 ERROR [M:0;jenkins-hbase4:34205] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 20:00:35,842 INFO [M:0;jenkins-hbase4:34205] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:35,842 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:35,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:35,842 DEBUG [M:0;jenkins-hbase4:34205] zookeeper.ZKUtil(398): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:35,842 WARN [M:0;jenkins-hbase4:34205] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:35,842 INFO [M:0;jenkins-hbase4:34205] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:35,842 INFO [M:0;jenkins-hbase4:34205] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:35,843 DEBUG [M:0;jenkins-hbase4:34205] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:35,843 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:35,843 DEBUG [M:0;jenkins-hbase4:34205] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:35,843 DEBUG [M:0;jenkins-hbase4:34205] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:35,843 DEBUG [M:0;jenkins-hbase4:34205] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:35,843 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.15 KB heapSize=200.04 KB 2023-02-19 20:00:35,851 INFO [M:0;jenkins-hbase4:34205] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.15 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/40ffc95d19964a02ac044ad19a86bfe8 2023-02-19 20:00:35,855 DEBUG [M:0;jenkins-hbase4:34205] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/40ffc95d19964a02ac044ad19a86bfe8 as hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/40ffc95d19964a02ac044ad19a86bfe8 2023-02-19 20:00:35,859 INFO [M:0;jenkins-hbase4:34205] regionserver.HStore(1080): Added hdfs://localhost:37583/user/jenkins/test-data/176a7c5d-7c98-340a-b99c-d466a2e6cb1f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/40ffc95d19964a02ac044ad19a86bfe8, entries=53, sequenceid=357, filesize=10.7 K 2023-02-19 20:00:35,859 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegion(2947): Finished flush of dataSize ~167.15 KB/171162, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-19 20:00:35,860 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:35,860 DEBUG [M:0;jenkins-hbase4:34205] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:35,863 INFO [M:0;jenkins-hbase4:34205] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:35,863 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:35,864 INFO [M:0;jenkins-hbase4:34205] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34205 2023-02-19 20:00:35,866 DEBUG [M:0;jenkins-hbase4:34205] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34205,1676836829761 already deleted, retry=false 2023-02-19 20:00:35,922 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:35,922 INFO [RS:1;jenkins-hbase4:42493] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42493,1676836829827; zookeeper connection closed. 2023-02-19 20:00:35,922 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e15fa3a rejected from java.util.concurrent.ThreadPoolExecutor@13384584[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:35,922 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42493-0x1006e2b63e30002, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:35,922 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@757ba8b0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@757ba8b0 2023-02-19 20:00:35,922 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36e3b762 rejected from java.util.concurrent.ThreadPoolExecutor@13384584[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:36,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:36,122 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:36,122 INFO [M:0;jenkins-hbase4:34205] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34205,1676836829761; zookeeper connection closed. 2023-02-19 20:00:36,122 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@793281ac rejected from java.util.concurrent.ThreadPoolExecutor@7d0d1a52[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:36,123 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): master:34205-0x1006e2b63e30000, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:36,123 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64af81d5 rejected from java.util.concurrent.ThreadPoolExecutor@7d0d1a52[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:36,222 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:36,222 INFO [RS:0;jenkins-hbase4:42789] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42789,1676836829804; zookeeper connection closed. 2023-02-19 20:00:36,223 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52b259d1 rejected from java.util.concurrent.ThreadPoolExecutor@30ebc689[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:36,223 DEBUG [Listener at localhost/34071-EventThread] zookeeper.ZKWatcher(600): regionserver:42789-0x1006e2b63e30001, quorum=127.0.0.1:64895, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:36,223 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b848a55] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b848a55 2023-02-19 20:00:36,223 ERROR [Listener at localhost/34071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a67f4cd rejected from java.util.concurrent.ThreadPoolExecutor@30ebc689[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:36,223 INFO [Listener at localhost/34071] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:36,224 WARN [Listener at localhost/34071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:36,227 INFO [Listener at localhost/34071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:36,336 WARN [BP-358116787-172.31.14.131-1676836829131 heartbeating to localhost/127.0.0.1:37583] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:36,336 WARN [BP-358116787-172.31.14.131-1676836829131 heartbeating to localhost/127.0.0.1:37583] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-358116787-172.31.14.131-1676836829131 (Datanode Uuid 98325058-b552-403b-be73-c6ba0bf964d2) service to localhost/127.0.0.1:37583 2023-02-19 20:00:36,337 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/dfs/data/data3/current/BP-358116787-172.31.14.131-1676836829131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:36,337 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/dfs/data/data4/current/BP-358116787-172.31.14.131-1676836829131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:36,339 WARN [Listener at localhost/34071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:36,341 INFO [Listener at localhost/34071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:36,450 WARN [BP-358116787-172.31.14.131-1676836829131 heartbeating to localhost/127.0.0.1:37583] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:36,450 WARN [BP-358116787-172.31.14.131-1676836829131 heartbeating to localhost/127.0.0.1:37583] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-358116787-172.31.14.131-1676836829131 (Datanode Uuid 49b5b41c-7698-4ca4-b03d-26700ee5816f) service to localhost/127.0.0.1:37583 2023-02-19 20:00:36,451 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/dfs/data/data1/current/BP-358116787-172.31.14.131-1676836829131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:36,451 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/cluster_f3d5c550-bd24-03ea-4c11-e90477e75b15/dfs/data/data2/current/BP-358116787-172.31.14.131-1676836829131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:36,462 INFO [Listener at localhost/34071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:36,582 INFO [Listener at localhost/34071] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:36,619 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:36,635 INFO [Listener at localhost/34071] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=232 (was 181) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,34205,1676836829761)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37583 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37583 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37583 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37583 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:37583 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:37583 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37583 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=634 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=496 (was 424) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8987 (was 9203) 2023-02-19 20:00:36,645 INFO [Listener at localhost/34071] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=232, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=496, ProcessCount=170, AvailableMemoryMB=8987 2023-02-19 20:00:36,655 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/hadoop.log.dir so I do NOT create it in target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8 2023-02-19 20:00:36,655 WARN [Listener at localhost/34071] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 20:00:36,655 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/hadoop.tmp.dir so I do NOT create it in target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8 2023-02-19 20:00:36,655 WARN [Listener at localhost/34071] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f10ea73e-f861-ad00-19a0-18181ad3bd65/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 20:00:36,655 DEBUG [Listener at localhost/34071] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8 2023-02-19 20:00:36,655 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:00:36,655 INFO [Listener at localhost/34071] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b, deleteOnExit=true 2023-02-19 20:00:36,655 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/test.cache.data in system properties and HBase conf 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:00:36,656 DEBUG [Listener at localhost/34071] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:00:36,656 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:36,657 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:00:36,658 INFO [Listener at localhost/34071] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:00:36,662 WARN [Listener at localhost/34071] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:36,662 WARN [Listener at localhost/34071] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:36,700 WARN [Listener at localhost/34071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:36,702 INFO [Listener at localhost/34071] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:36,707 INFO [Listener at localhost/34071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/java.io.tmpdir/Jetty_localhost_34507_hdfs____.frklsr/webapp 2023-02-19 20:00:36,808 INFO [Listener at localhost/34071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34507 2023-02-19 20:00:36,848 WARN [Listener at localhost/34071] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:36,848 WARN [Listener at localhost/34071] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:37,100 WARN [Listener at localhost/43177] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:37,115 WARN [Listener at localhost/43177] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:37,117 WARN [Listener at localhost/43177] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:37,118 INFO [Listener at localhost/43177] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:37,122 INFO [Listener at localhost/43177] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/java.io.tmpdir/Jetty_localhost_44635_datanode____8l0dj3/webapp 2023-02-19 20:00:37,215 INFO [Listener at localhost/43177] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44635 2023-02-19 20:00:37,222 WARN [Listener at localhost/37907] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:37,239 WARN [Listener at localhost/37907] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:37,241 WARN [Listener at localhost/37907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:37,242 INFO [Listener at localhost/37907] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:37,245 INFO [Listener at localhost/37907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/java.io.tmpdir/Jetty_localhost_46023_datanode____28c7iu/webapp 2023-02-19 20:00:37,422 INFO [Listener at localhost/37907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46023 2023-02-19 20:00:37,433 WARN [Listener at localhost/39285] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:39,601 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5ccf55396985eaf: Processing first storage report for DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc from datanode d95dce95-dd6f-4c74-afae-2e07dbc44cf8 2023-02-19 20:00:39,601 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5ccf55396985eaf: from storage DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc node DatanodeRegistration(127.0.0.1:43433, datanodeUuid=d95dce95-dd6f-4c74-afae-2e07dbc44cf8, infoPort=43161, infoSecurePort=0, ipcPort=37907, storageInfo=lv=-57;cid=testClusterID;nsid=1688399814;c=1676836836664), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:39,601 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5ccf55396985eaf: Processing first storage report for DS-c55cf2b8-d1ea-4fd3-8cdd-dbd2a7534f0c from datanode d95dce95-dd6f-4c74-afae-2e07dbc44cf8 2023-02-19 20:00:39,601 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5ccf55396985eaf: from storage DS-c55cf2b8-d1ea-4fd3-8cdd-dbd2a7534f0c node DatanodeRegistration(127.0.0.1:43433, datanodeUuid=d95dce95-dd6f-4c74-afae-2e07dbc44cf8, infoPort=43161, infoSecurePort=0, ipcPort=37907, storageInfo=lv=-57;cid=testClusterID;nsid=1688399814;c=1676836836664), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:39,677 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5720dbf8c3b2117: Processing first storage report for DS-7e243134-0577-4bf9-bd03-8666935e7934 from datanode d9e3f87b-ca4f-49fd-bfc0-b7569cad59ae 2023-02-19 20:00:39,677 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5720dbf8c3b2117: from storage DS-7e243134-0577-4bf9-bd03-8666935e7934 node DatanodeRegistration(127.0.0.1:40605, datanodeUuid=d9e3f87b-ca4f-49fd-bfc0-b7569cad59ae, infoPort=37021, infoSecurePort=0, ipcPort=39285, storageInfo=lv=-57;cid=testClusterID;nsid=1688399814;c=1676836836664), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:39,678 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5720dbf8c3b2117: Processing first storage report for DS-be965fb4-cb34-4d9a-bc00-075d7f878560 from datanode d9e3f87b-ca4f-49fd-bfc0-b7569cad59ae 2023-02-19 20:00:39,678 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5720dbf8c3b2117: from storage DS-be965fb4-cb34-4d9a-bc00-075d7f878560 node DatanodeRegistration(127.0.0.1:40605, datanodeUuid=d9e3f87b-ca4f-49fd-bfc0-b7569cad59ae, infoPort=37021, infoSecurePort=0, ipcPort=39285, storageInfo=lv=-57;cid=testClusterID;nsid=1688399814;c=1676836836664), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:39,678 DEBUG [Listener at localhost/39285] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8 2023-02-19 20:00:39,681 INFO [Listener at localhost/39285] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/zookeeper_0, clientPort=58449, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:00:39,682 INFO [Listener at localhost/39285] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58449 2023-02-19 20:00:39,682 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,683 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,697 INFO [Listener at localhost/39285] util.FSUtils(479): Created version file at hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e with version=8 2023-02-19 20:00:39,697 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,699 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,700 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/hbase-staging 2023-02-19 20:00:39,701 INFO [Listener at localhost/39285] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:39,702 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,702 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,702 INFO [Listener at localhost/39285] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:39,702 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,702 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:39,702 INFO [Listener at localhost/39285] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:39,703 INFO [Listener at localhost/39285] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38279 2023-02-19 20:00:39,703 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,704 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,704 INFO [Listener at localhost/39285] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38279 connecting to ZooKeeper ensemble=127.0.0.1:58449 2023-02-19 20:00:39,730 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:382790x0, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:39,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38279-0x1006e2b8ac50000 connected 2023-02-19 20:00:39,789 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:39,789 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:39,789 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:39,790 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38279 2023-02-19 20:00:39,790 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38279 2023-02-19 20:00:39,790 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38279 2023-02-19 20:00:39,791 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38279 2023-02-19 20:00:39,791 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38279 2023-02-19 20:00:39,791 INFO [Listener at localhost/39285] master.HMaster(444): hbase.rootdir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e, hbase.cluster.distributed=false 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:39,803 INFO [Listener at localhost/39285] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:39,804 INFO [Listener at localhost/39285] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40095 2023-02-19 20:00:39,804 INFO [Listener at localhost/39285] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:39,806 DEBUG [Listener at localhost/39285] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:39,807 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,808 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,809 INFO [Listener at localhost/39285] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40095 connecting to ZooKeeper ensemble=127.0.0.1:58449 2023-02-19 20:00:39,813 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:400950x0, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:39,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40095-0x1006e2b8ac50001 connected 2023-02-19 20:00:39,814 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:39,815 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:39,815 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:39,816 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40095 2023-02-19 20:00:39,816 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40095 2023-02-19 20:00:39,816 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40095 2023-02-19 20:00:39,817 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40095 2023-02-19 20:00:39,817 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40095 2023-02-19 20:00:39,828 INFO [Listener at localhost/39285] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:39,828 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,828 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,828 INFO [Listener at localhost/39285] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:39,828 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:39,829 INFO [Listener at localhost/39285] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:39,829 INFO [Listener at localhost/39285] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:39,830 INFO [Listener at localhost/39285] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35947 2023-02-19 20:00:39,830 INFO [Listener at localhost/39285] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:39,830 DEBUG [Listener at localhost/39285] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:39,831 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,832 INFO [Listener at localhost/39285] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,832 INFO [Listener at localhost/39285] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35947 connecting to ZooKeeper ensemble=127.0.0.1:58449 2023-02-19 20:00:39,842 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:359470x0, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:39,843 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): regionserver:359470x0, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:39,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35947-0x1006e2b8ac50002 connected 2023-02-19 20:00:39,844 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:39,844 DEBUG [Listener at localhost/39285] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:39,844 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35947 2023-02-19 20:00:39,845 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35947 2023-02-19 20:00:39,845 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35947 2023-02-19 20:00:39,845 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35947 2023-02-19 20:00:39,846 DEBUG [Listener at localhost/39285] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35947 2023-02-19 20:00:39,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,849 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:39,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,857 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:39,857 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:39,857 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:39,857 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:39,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:39,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38279,1676836839701 from backup master directory 2023-02-19 20:00:39,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:39,878 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,878 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:39,878 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:39,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/hbase.id with ID: 1461e984-51f5-4254-8ed8-4971626f09a5 2023-02-19 20:00:39,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:39,899 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:39,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0db8f352 to 127.0.0.1:58449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:39,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6410946c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:39,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:39,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:39,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:39,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store-tmp 2023-02-19 20:00:39,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:39,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:39,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:39,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:39,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:39,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:39,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:39,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:39,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/WALs/jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38279%2C1676836839701, suffix=, logDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/WALs/jenkins-hbase4.apache.org,38279,1676836839701, archiveDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:39,938 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK] 2023-02-19 20:00:39,938 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK] 2023-02-19 20:00:39,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/WALs/jenkins-hbase4.apache.org,38279,1676836839701/jenkins-hbase4.apache.org%2C38279%2C1676836839701.1676836839925 2023-02-19 20:00:39,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK], DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK]] 2023-02-19 20:00:39,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:39,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:39,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:39,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:39,941 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:39,942 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:39,942 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:39,943 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:39,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:39,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:39,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:39,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:39,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70054025, jitterRate=0.04388631880283356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:39,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:39,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:39,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:39,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:39,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:39,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 20:00:39,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 20:00:39,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:39,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:39,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:39,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:39,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:39,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:39,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:39,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:39,964 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:39,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:39,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:39,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:39,967 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:39,967 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:39,967 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:39,967 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:39,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38279,1676836839701, sessionid=0x1006e2b8ac50000, setting cluster-up flag (Was=false) 2023-02-19 20:00:39,972 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:39,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:39,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,980 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:39,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:39,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:39,985 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.hbase-snapshot/.tmp 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:39,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836869987 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:39,988 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:39,988 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:39,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836839989,5,FailOnTimeoutGroup] 2023-02-19 20:00:39,989 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:39,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836839989,5,FailOnTimeoutGroup] 2023-02-19 20:00:39,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:39,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:39,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:39,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:39,996 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:39,997 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:39,997 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e 2023-02-19 20:00:40,002 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:40,004 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:40,005 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/info 2023-02-19 20:00:40,005 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:40,005 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:40,006 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:40,007 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:40,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:40,008 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/table 2023-02-19 20:00:40,008 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:40,008 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,009 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740 2023-02-19 20:00:40,009 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740 2023-02-19 20:00:40,011 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:40,011 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:40,013 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73428064, jitterRate=0.09416341781616211}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:40,013 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:40,013 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:40,013 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:40,014 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:40,014 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:40,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:40,016 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:40,017 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:40,048 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(952): ClusterId : 1461e984-51f5-4254-8ed8-4971626f09a5 2023-02-19 20:00:40,048 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(952): ClusterId : 1461e984-51f5-4254-8ed8-4971626f09a5 2023-02-19 20:00:40,048 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:40,048 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:40,050 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:40,050 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:40,050 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:40,050 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:40,056 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:40,057 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:40,057 DEBUG [RS:0;jenkins-hbase4:40095] zookeeper.ReadOnlyZKClient(139): Connect 0x0494a544 to 127.0.0.1:58449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:40,058 DEBUG [RS:1;jenkins-hbase4:35947] zookeeper.ReadOnlyZKClient(139): Connect 0x106d4e93 to 127.0.0.1:58449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:40,063 DEBUG [RS:0;jenkins-hbase4:40095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a535ba6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:40,063 DEBUG [RS:1;jenkins-hbase4:35947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eaaa2ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:40,063 DEBUG [RS:0;jenkins-hbase4:40095] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e6cce34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:40,063 DEBUG [RS:1;jenkins-hbase4:35947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a9525e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:40,077 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35947 2023-02-19 20:00:40,077 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40095 2023-02-19 20:00:40,077 INFO [RS:1;jenkins-hbase4:35947] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:40,077 INFO [RS:1;jenkins-hbase4:35947] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:40,077 INFO [RS:0;jenkins-hbase4:40095] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:40,077 INFO [RS:0;jenkins-hbase4:40095] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:40,077 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:40,077 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:40,077 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38279,1676836839701 with isa=jenkins-hbase4.apache.org/172.31.14.131:35947, startcode=1676836839827 2023-02-19 20:00:40,077 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38279,1676836839701 with isa=jenkins-hbase4.apache.org/172.31.14.131:40095, startcode=1676836839802 2023-02-19 20:00:40,078 DEBUG [RS:0;jenkins-hbase4:40095] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:40,078 DEBUG [RS:1;jenkins-hbase4:35947] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:40,079 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45449, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:40,079 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44087, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:40,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38279] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,081 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e 2023-02-19 20:00:40,081 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43177 2023-02-19 20:00:40,081 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:40,081 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e 2023-02-19 20:00:40,082 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43177 2023-02-19 20:00:40,082 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:40,086 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:40,086 DEBUG [RS:0;jenkins-hbase4:40095] zookeeper.ZKUtil(162): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,087 DEBUG [RS:1;jenkins-hbase4:35947] zookeeper.ZKUtil(162): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,087 WARN [RS:0;jenkins-hbase4:40095] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:40,087 WARN [RS:1;jenkins-hbase4:35947] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:40,087 INFO [RS:0;jenkins-hbase4:40095] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:40,087 INFO [RS:1;jenkins-hbase4:35947] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:40,087 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,087 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35947,1676836839827] 2023-02-19 20:00:40,087 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40095,1676836839802] 2023-02-19 20:00:40,087 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,093 DEBUG [RS:0;jenkins-hbase4:40095] zookeeper.ZKUtil(162): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,093 DEBUG [RS:1;jenkins-hbase4:35947] zookeeper.ZKUtil(162): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,093 DEBUG [RS:0;jenkins-hbase4:40095] zookeeper.ZKUtil(162): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,093 DEBUG [RS:1;jenkins-hbase4:35947] zookeeper.ZKUtil(162): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,093 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:40,094 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:40,094 INFO [RS:0;jenkins-hbase4:40095] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:40,094 INFO [RS:1;jenkins-hbase4:35947] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:40,098 INFO [RS:0;jenkins-hbase4:40095] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:40,098 INFO [RS:1;jenkins-hbase4:35947] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:40,098 INFO [RS:0;jenkins-hbase4:40095] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:40,098 INFO [RS:1;jenkins-hbase4:35947] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:40,098 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,098 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,099 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:40,099 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:40,100 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,100 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,100 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,100 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,101 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,102 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,102 DEBUG [RS:0;jenkins-hbase4:40095] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,102 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,102 DEBUG [RS:1;jenkins-hbase4:35947] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:40,103 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,103 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,103 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,103 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,104 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,104 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,115 INFO [RS:1;jenkins-hbase4:35947] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:40,115 INFO [RS:0;jenkins-hbase4:40095] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:40,115 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35947,1676836839827-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,115 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40095,1676836839802-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,127 INFO [RS:1;jenkins-hbase4:35947] regionserver.Replication(203): jenkins-hbase4.apache.org,35947,1676836839827 started 2023-02-19 20:00:40,127 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35947,1676836839827, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35947, sessionid=0x1006e2b8ac50002 2023-02-19 20:00:40,127 INFO [RS:0;jenkins-hbase4:40095] regionserver.Replication(203): jenkins-hbase4.apache.org,40095,1676836839802 started 2023-02-19 20:00:40,127 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:40,127 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40095,1676836839802, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40095, sessionid=0x1006e2b8ac50001 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40095,1676836839802' 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35947,1676836839827' 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:40,128 DEBUG [RS:0;jenkins-hbase4:40095] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,129 DEBUG [RS:0;jenkins-hbase4:40095] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40095,1676836839802' 2023-02-19 20:00:40,129 DEBUG [RS:0;jenkins-hbase4:40095] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:40,128 DEBUG [RS:1;jenkins-hbase4:35947] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,129 DEBUG [RS:1;jenkins-hbase4:35947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35947,1676836839827' 2023-02-19 20:00:40,129 DEBUG [RS:1;jenkins-hbase4:35947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:40,129 DEBUG [RS:0;jenkins-hbase4:40095] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:40,129 DEBUG [RS:1;jenkins-hbase4:35947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:40,129 DEBUG [RS:0;jenkins-hbase4:40095] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:40,129 INFO [RS:0;jenkins-hbase4:40095] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:40,129 INFO [RS:0;jenkins-hbase4:40095] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:40,129 DEBUG [RS:1;jenkins-hbase4:35947] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:40,129 INFO [RS:1;jenkins-hbase4:35947] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:40,129 INFO [RS:1;jenkins-hbase4:35947] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:40,167 DEBUG [jenkins-hbase4:38279] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:40,167 DEBUG [jenkins-hbase4:38279] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:40,169 DEBUG [jenkins-hbase4:38279] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:40,169 DEBUG [jenkins-hbase4:38279] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:40,169 DEBUG [jenkins-hbase4:38279] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:40,169 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40095,1676836839802, state=OPENING 2023-02-19 20:00:40,170 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:40,171 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:40,174 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:40,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40095,1676836839802}] 2023-02-19 20:00:40,328 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:40,328 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:40,330 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60610, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:40,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:40,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:40,334 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40095%2C1676836839802.meta, suffix=.meta, logDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,40095,1676836839802, archiveDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/oldWALs, maxLogs=32 2023-02-19 20:00:40,347 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK] 2023-02-19 20:00:40,347 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK] 2023-02-19 20:00:40,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,40095,1676836839802/jenkins-hbase4.apache.org%2C40095%2C1676836839802.meta.1676836840334.meta 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK], DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK]] 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:40,349 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:40,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:40,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:40,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/info 2023-02-19 20:00:40,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/info 2023-02-19 20:00:40,352 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:40,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:40,353 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:40,353 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:40,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:40,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:40,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/table 2023-02-19 20:00:40,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/table 2023-02-19 20:00:40,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:40,354 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740 2023-02-19 20:00:40,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740 2023-02-19 20:00:40,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:40,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:40,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75453586, jitterRate=0.1243460476398468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:40,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:40,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836840328 2023-02-19 20:00:40,362 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:40,362 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:40,362 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40095,1676836839802, state=OPEN 2023-02-19 20:00:40,364 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:40,364 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:40,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:40,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40095,1676836839802 in 192 msec 2023-02-19 20:00:40,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:40,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 351 msec 2023-02-19 20:00:40,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 381 msec 2023-02-19 20:00:40,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836840367, completionTime=-1 2023-02-19 20:00:40,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:40,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:40,369 DEBUG [hconnection-0x247d4b7f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:40,370 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:40,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:40,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836900372 2023-02-19 20:00:40,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836960372 2023-02-19 20:00:40,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38279,1676836839701-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38279,1676836839701-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38279,1676836839701-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38279, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:40,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:40,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:40,379 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:40,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:40,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:40,382 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,382 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1 empty. 2023-02-19 20:00:40,382 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,382 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:40,390 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:40,391 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f84613ee8ed4e42ae617674d8532dce1, NAME => 'hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp 2023-02-19 20:00:40,396 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:40,396 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f84613ee8ed4e42ae617674d8532dce1, disabling compactions & flushes 2023-02-19 20:00:40,396 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,396 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,396 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. after waiting 0 ms 2023-02-19 20:00:40,396 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,396 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,396 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f84613ee8ed4e42ae617674d8532dce1: 2023-02-19 20:00:40,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:40,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836840398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836840398"}]},"ts":"1676836840398"} 2023-02-19 20:00:40,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:40,400 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:40,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836840401"}]},"ts":"1676836840401"} 2023-02-19 20:00:40,401 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:40,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:40,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:40,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:40,404 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:40,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f84613ee8ed4e42ae617674d8532dce1, ASSIGN}] 2023-02-19 20:00:40,406 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f84613ee8ed4e42ae617674d8532dce1, ASSIGN 2023-02-19 20:00:40,407 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f84613ee8ed4e42ae617674d8532dce1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35947,1676836839827; forceNewPlan=false, retain=false 2023-02-19 20:00:40,557 INFO [jenkins-hbase4:38279] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:40,557 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f84613ee8ed4e42ae617674d8532dce1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,558 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836840557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836840557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836840557"}]},"ts":"1676836840557"} 2023-02-19 20:00:40,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f84613ee8ed4e42ae617674d8532dce1, server=jenkins-hbase4.apache.org,35947,1676836839827}] 2023-02-19 20:00:40,712 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,712 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:40,713 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58762, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:40,717 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,718 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35947%2C1676836839827, suffix=, logDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,35947,1676836839827, archiveDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/oldWALs, maxLogs=32 2023-02-19 20:00:40,731 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK] 2023-02-19 20:00:40,731 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK] 2023-02-19 20:00:40,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,35947,1676836839827/jenkins-hbase4.apache.org%2C35947%2C1676836839827.1676836840718 2023-02-19 20:00:40,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK], DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK]] 2023-02-19 20:00:40,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f84613ee8ed4e42ae617674d8532dce1, NAME => 'hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:40,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:40,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,734 INFO [StoreOpener-f84613ee8ed4e42ae617674d8532dce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,735 DEBUG [StoreOpener-f84613ee8ed4e42ae617674d8532dce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/info 2023-02-19 20:00:40,735 DEBUG [StoreOpener-f84613ee8ed4e42ae617674d8532dce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/info 2023-02-19 20:00:40,735 INFO [StoreOpener-f84613ee8ed4e42ae617674d8532dce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f84613ee8ed4e42ae617674d8532dce1 columnFamilyName info 2023-02-19 20:00:40,736 INFO [StoreOpener-f84613ee8ed4e42ae617674d8532dce1-1] regionserver.HStore(310): Store=f84613ee8ed4e42ae617674d8532dce1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:40,736 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,738 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:40,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:40,740 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f84613ee8ed4e42ae617674d8532dce1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62285705, jitterRate=-0.07187066972255707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:40,740 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f84613ee8ed4e42ae617674d8532dce1: 2023-02-19 20:00:40,741 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1., pid=6, masterSystemTime=1676836840711 2023-02-19 20:00:40,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,744 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:40,745 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f84613ee8ed4e42ae617674d8532dce1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:40,745 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836840745"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836840745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836840745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836840745"}]},"ts":"1676836840745"} 2023-02-19 20:00:40,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:40,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f84613ee8ed4e42ae617674d8532dce1, server=jenkins-hbase4.apache.org,35947,1676836839827 in 187 msec 2023-02-19 20:00:40,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:40,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f84613ee8ed4e42ae617674d8532dce1, ASSIGN in 342 msec 2023-02-19 20:00:40,749 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:40,749 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836840749"}]},"ts":"1676836840749"} 2023-02-19 20:00:40,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:40,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:40,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 374 msec 2023-02-19 20:00:40,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:40,781 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:40,781 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:40,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:40,784 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58766, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:40,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:40,793 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:40,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-19 20:00:40,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:40,803 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:40,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-19 20:00:40,810 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:40,813 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:40,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.934sec 2023-02-19 20:00:40,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:40,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:40,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:40,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38279,1676836839701-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:40,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38279,1676836839701-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:40,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:40,848 DEBUG [Listener at localhost/39285] zookeeper.ReadOnlyZKClient(139): Connect 0x43a19780 to 127.0.0.1:58449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:40,856 DEBUG [Listener at localhost/39285] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50548743, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:40,858 DEBUG [hconnection-0x379c2ed5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:40,860 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60626, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:40,861 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:40,861 DEBUG [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:40,865 DEBUG [Listener at localhost/39285] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:40,866 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35136, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:40,867 INFO [Listener at localhost/39285] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-19 20:00:40,867 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-19 20:00:40,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:40,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:35136 deadline: 1676836900867, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-19 20:00:40,868 INFO [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-19 20:00:40,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:40,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:40,871 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:40,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-19 20:00:40,872 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:40,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:40,873 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:40,874 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c empty. 2023-02-19 20:00:40,874 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:40,874 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-19 20:00:40,881 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:40,882 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3819e12cf28ea91d34ba45360e8bdf9c, NAME => 'testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp 2023-02-19 20:00:40,888 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:40,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 3819e12cf28ea91d34ba45360e8bdf9c, disabling compactions & flushes 2023-02-19 20:00:40,889 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:40,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:40,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. after waiting 0 ms 2023-02-19 20:00:40,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:40,889 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:40,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:40,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:40,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676836840891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836840891"}]},"ts":"1676836840891"} 2023-02-19 20:00:40,892 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:40,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:40,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836840893"}]},"ts":"1676836840893"} 2023-02-19 20:00:40,894 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-19 20:00:40,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:40,899 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:40,899 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:40,899 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:40,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, ASSIGN}] 2023-02-19 20:00:40,901 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, ASSIGN 2023-02-19 20:00:40,901 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35947,1676836839827; forceNewPlan=false, retain=false 2023-02-19 20:00:40,912 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:40,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:41,051 INFO [jenkins-hbase4:38279] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:41,052 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3819e12cf28ea91d34ba45360e8bdf9c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,052 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676836841052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836841052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836841052"}]},"ts":"1676836841052"} 2023-02-19 20:00:41,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 3819e12cf28ea91d34ba45360e8bdf9c, server=jenkins-hbase4.apache.org,35947,1676836839827}] 2023-02-19 20:00:41,131 INFO [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40095%2C1676836839802, suffix=, logDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,40095,1676836839802, archiveDir=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/oldWALs, maxLogs=32 2023-02-19 20:00:41,144 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK] 2023-02-19 20:00:41,144 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK] 2023-02-19 20:00:41,146 INFO [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/WALs/jenkins-hbase4.apache.org,40095,1676836839802/jenkins-hbase4.apache.org%2C40095%2C1676836839802.1676836841131 2023-02-19 20:00:41,146 DEBUG [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43433,DS-ad5ae86a-d838-45f5-81b9-6f7764774dcc,DISK], DatanodeInfoWithStorage[127.0.0.1:40605,DS-7e243134-0577-4bf9-bd03-8666935e7934,DISK]] 2023-02-19 20:00:41,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:41,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:41,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3819e12cf28ea91d34ba45360e8bdf9c, NAME => 'testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:41,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:41,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,209 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,210 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1 2023-02-19 20:00:41,211 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1 2023-02-19 20:00:41,211 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3819e12cf28ea91d34ba45360e8bdf9c columnFamilyName f1 2023-02-19 20:00:41,211 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(310): Store=3819e12cf28ea91d34ba45360e8bdf9c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:41,211 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,212 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2 2023-02-19 20:00:41,212 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2 2023-02-19 20:00:41,212 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3819e12cf28ea91d34ba45360e8bdf9c columnFamilyName f2 2023-02-19 20:00:41,213 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(310): Store=3819e12cf28ea91d34ba45360e8bdf9c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:41,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:41,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:41,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:41,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3819e12cf28ea91d34ba45360e8bdf9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69376127, jitterRate=0.03378485143184662}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:41,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:41,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c., pid=12, masterSystemTime=1676836841205 2023-02-19 20:00:41,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:41,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:41,219 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3819e12cf28ea91d34ba45360e8bdf9c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,219 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676836841219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836841219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836841219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836841219"}]},"ts":"1676836841219"} 2023-02-19 20:00:41,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 20:00:41,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 3819e12cf28ea91d34ba45360e8bdf9c, server=jenkins-hbase4.apache.org,35947,1676836839827 in 167 msec 2023-02-19 20:00:41,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 20:00:41,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, ASSIGN in 323 msec 2023-02-19 20:00:41,223 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:41,223 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836841223"}]},"ts":"1676836841223"} 2023-02-19 20:00:41,224 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-19 20:00:41,226 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:41,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 356 msec 2023-02-19 20:00:41,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:41,477 INFO [Listener at localhost/39285] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-19 20:00:41,477 DEBUG [Listener at localhost/39285] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-19 20:00:41,477 INFO [Listener at localhost/39285] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:41,481 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-19 20:00:41,481 INFO [Listener at localhost/39285] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:41,481 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-19 20:00:41,481 INFO [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:41,493 DEBUG [hconnection-0x379c2ed5-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:41,504 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58768, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:41,511 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35947] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:41,599 INFO [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:41,599 INFO [Listener at localhost/39285] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:41,600 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 20:00:41,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836841601 (current time:1676836841601). 2023-02-19 20:00:41,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:41,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] zookeeper.ReadOnlyZKClient(139): Connect 0x7ad61b28 to 127.0.0.1:58449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:41,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f5b1bec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:41,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:41,606 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60632, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:41,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ad61b28 to 127.0.0.1:58449 2023-02-19 20:00:41,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:41,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:41,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 20:00:41,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 20:00:41,611 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 20:00:41,611 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676837441611 2023-02-19 20:00:41,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 20:00:41,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,612 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:41,613 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:41,615 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 20:00:41,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 20:00:41,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 6 msec 2023-02-19 20:00:41,617 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 20:00:41,617 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676837441617 2023-02-19 20:00:41,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,624 INFO [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-19 20:00:41,624 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:41,625 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-19 20:00:41,625 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 20:00:41,625 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,625 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,627 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:41,627 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:41,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:41,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:41,627 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:41,628 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,628 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:41,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-19 20:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-19 20:00:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:41,630 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 20:00:41,630 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 20:00:41,630 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 20:00:41,630 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 20:00:41,630 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35947,1676836839827' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 20:00:41,630 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40095,1676836839802' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 20:00:41,632 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,632 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:41,632 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,632 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,632 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:41,632 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,632 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:41,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35947,1676836839827' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-19 20:00:41,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45c084e6[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:41,634 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 20:00:41,634 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,635 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 20:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 20:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 20:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40095,1676836839802' in zk 2023-02-19 20:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 20:00:41,635 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:41,635 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:41,635 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. started... 2023-02-19 20:00:41,636 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3819e12cf28ea91d34ba45360e8bdf9c 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 20:00:41,637 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 20:00:41,637 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:41,637 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 20:00:41,649 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f1/ad0a0052e52c42ac8fb0ea0f81be9410 2023-02-19 20:00:41,665 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f2/3831f2260434466dadd9414e6a65d7df 2023-02-19 20:00:41,669 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f1/ad0a0052e52c42ac8fb0ea0f81be9410 as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/ad0a0052e52c42ac8fb0ea0f81be9410 2023-02-19 20:00:41,672 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/ad0a0052e52c42ac8fb0ea0f81be9410, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:41,672 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f2/3831f2260434466dadd9414e6a65d7df as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/3831f2260434466dadd9414e6a65d7df 2023-02-19 20:00:41,675 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/3831f2260434466dadd9414e6a65d7df, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:41,676 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 3819e12cf28ea91d34ba45360e8bdf9c in 41ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:41,676 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-19 20:00:41,676 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:41,676 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,676 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:41,676 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/ad0a0052e52c42ac8fb0ea0f81be9410] hfiles 2023-02-19 20:00:41,676 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/ad0a0052e52c42ac8fb0ea0f81be9410 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,677 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/3831f2260434466dadd9414e6a65d7df] hfiles 2023-02-19 20:00:41,677 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/3831f2260434466dadd9414e6a65d7df for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,681 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. completed. 2023-02-19 20:00:41,681 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:41,681 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 20:00:41,681 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 20:00:41,681 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,681 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 20:00:41,681 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35947,1676836839827' in zk 2023-02-19 20:00:41,684 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,684 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 20:00:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:41,684 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:41,684 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 20:00:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,35947,1676836839827': 2023-02-19 20:00:41,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35947,1676836839827' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:41,687 INFO [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-19 20:00:41,687 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:41,687 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:41,687 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,687 INFO [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:41,688 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,688 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,688 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:41,688 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,689 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:41,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:41,689 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:41,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,689 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,690 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:41,691 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:41,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:41,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:41,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,696 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:41,696 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:41,697 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,697 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:41,697 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,697 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:41,697 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,697 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:41,713 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:41,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-19 20:00:41,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:41,715 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:41,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-19 20:00:41,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,735 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:41,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676836841611Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676836841696 (+85 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676836841696Writing data manifest for testWithMockedMapReduceSingleRegion at 1676836841700 (+4 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676836841715 (+15 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676836841734 (+19 ms) 2023-02-19 20:00:41,737 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 20:00:41,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 122 msec 2023-02-19 20:00:41,915 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:41,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-19 20:00:41,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:41,917 INFO [Listener at localhost/39285] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:41,921 INFO [Listener at localhost/39285] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:41,926 INFO [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:41,955 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35947] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,080 INFO [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:42,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:42,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,087 INFO [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-19 20:00:42,087 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:42,088 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-19 20:00:42,088 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 20:00:42,088 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,089 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,090 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:42,091 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:42,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:42,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:42,091 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:42,091 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,091 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-19 20:00:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-19 20:00:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 20:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 20:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 20:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40095,1676836839802' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 20:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 20:00:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:42,095 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,095 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. started... 2023-02-19 20:00:42,095 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3819e12cf28ea91d34ba45360e8bdf9c 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 20:00:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,099 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,099 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:42,112 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f1/1ef55aec400340a2b234670d848d17fc 2023-02-19 20:00:42,134 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f2/07d40988fb62498ab7cb860fc04d5c3e 2023-02-19 20:00:42,138 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f1/1ef55aec400340a2b234670d848d17fc as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/1ef55aec400340a2b234670d848d17fc 2023-02-19 20:00:42,142 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/1ef55aec400340a2b234670d848d17fc, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:42,143 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/.tmp/f2/07d40988fb62498ab7cb860fc04d5c3e as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/07d40988fb62498ab7cb860fc04d5c3e 2023-02-19 20:00:42,146 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/07d40988fb62498ab7cb860fc04d5c3e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:42,147 INFO [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 3819e12cf28ea91d34ba45360e8bdf9c in 52ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:42,148 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:42,148 DEBUG [rs(jenkins-hbase4.apache.org,35947,1676836839827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,148 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 20:00:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 20:00:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 20:00:42,149 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35947,1676836839827' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 20:00:42,151 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,151 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:42,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35947,1676836839827' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-19 20:00:42,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41ff1886[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:42,153 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 20:00:42,153 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,154 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,154 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 20:00:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 20:00:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 20:00:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35947,1676836839827' in zk 2023-02-19 20:00:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 20:00:42,155 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40095,1676836839802' in zk 2023-02-19 20:00:42,155 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,155 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:42,158 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,158 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 20:00:42,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:42,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:42,158 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 20:00:42,158 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:42,158 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:42,158 DEBUG [member: 'jenkins-hbase4.apache.org,35947,1676836839827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 20:00:42,158 DEBUG [member: 'jenkins-hbase4.apache.org,40095,1676836839802' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 20:00:42,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,35947,1676836839827': 2023-02-19 20:00:42,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35947,1676836839827' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:42,161 INFO [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-19 20:00:42,161 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:42,161 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:42,161 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,161 INFO [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:42,163 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,163 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:42,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:42,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,163 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:42,163 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,163 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:42,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:42,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:42,164 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,164 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,166 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:42,166 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,168 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:42,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:42,169 DEBUG [(jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:42,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-19 20:00:42,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:42,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:42,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:42,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:42,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:42,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:42,169 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,270 DEBUG [Listener at localhost/39285] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:42,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:42,275 INFO [Listener at localhost/39285] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676836841601 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:42,275 DEBUG [Listener at localhost/39285] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf/data/default/testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,275 INFO [Listener at localhost/39285] snapshot.RestoreSnapshotHelper(239): region to add: 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,276 INFO [Listener at localhost/39285] snapshot.RestoreSnapshotHelper(585): clone region=3819e12cf28ea91d34ba45360e8bdf9c as 3819e12cf28ea91d34ba45360e8bdf9c in snapshot testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,276 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3819e12cf28ea91d34ba45360e8bdf9c, NAME => 'testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf 2023-02-19 20:00:42,282 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:42,282 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ad0a0052e52c42ac8fb0ea0f81be9410 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,284 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3831f2260434466dadd9414e6a65d7df from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,285 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3819e12cf28ea91d34ba45360e8bdf9c, disabling compactions & flushes 2023-02-19 20:00:42,285 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,285 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. after waiting 0 ms 2023-02-19 20:00:42,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,286 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:42,286 INFO [Listener at localhost/39285] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676836841601 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:42,286 DEBUG [Listener at localhost/39285] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf 2023-02-19 20:00:42,286 DEBUG [Listener at localhost/39285] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf 2023-02-19 20:00:42,286 DEBUG [Listener at localhost/39285] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:42,287 DEBUG [Listener at localhost/39285] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:42,287 DEBUG [Listener at localhost/39285] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-19 20:00:42,287 DEBUG [Listener at localhost/39285] util.CommonFSUtils(699): |----------3819e12cf28ea91d34ba45360e8bdf9c/ 2023-02-19 20:00:42,288 DEBUG [Listener at localhost/39285] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:42,288 DEBUG [Listener at localhost/39285] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:42,288 DEBUG [Listener at localhost/39285] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=3819e12cf28ea91d34ba45360e8bdf9c-ad0a0052e52c42ac8fb0ea0f81be9410 2023-02-19 20:00:42,288 DEBUG [Listener at localhost/39285] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:42,288 DEBUG [Listener at localhost/39285] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=3819e12cf28ea91d34ba45360e8bdf9c-3831f2260434466dadd9414e6a65d7df 2023-02-19 20:00:42,291 INFO [Listener at localhost/39285] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 20:00:42,293 DEBUG [Listener at localhost/39285] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:42,294 INFO [Listener at localhost/39285] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:42,294 DEBUG [Listener at localhost/39285] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:42,296 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,296 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1 2023-02-19 20:00:42,297 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3819e12cf28ea91d34ba45360e8bdf9c columnFamilyName f1 2023-02-19 20:00:42,300 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(539): loaded hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/testWithMockedMapReduceSingleRegion=3819e12cf28ea91d34ba45360e8bdf9c-ad0a0052e52c42ac8fb0ea0f81be9410 2023-02-19 20:00:42,300 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(310): Store=3819e12cf28ea91d34ba45360e8bdf9c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:42,300 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,301 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2 2023-02-19 20:00:42,301 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3819e12cf28ea91d34ba45360e8bdf9c columnFamilyName f2 2023-02-19 20:00:42,304 DEBUG [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(539): loaded hdfs://localhost:43177/user/jenkins/test-data/a832c11c-7d58-a556-e9f5-a8e10de80a85/testWithMockedMapReduceSingleRegion/3de7af29-446e-44f1-acbb-5999027d88cf/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/testWithMockedMapReduceSingleRegion=3819e12cf28ea91d34ba45360e8bdf9c-3831f2260434466dadd9414e6a65d7df 2023-02-19 20:00:42,304 INFO [StoreOpener-3819e12cf28ea91d34ba45360e8bdf9c-1] regionserver.HStore(310): Store=3819e12cf28ea91d34ba45360e8bdf9c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:42,304 DEBUG [Listener at localhost/39285] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:42,304 INFO [Listener at localhost/39285] regionserver.HRegion(1071): Opened 3819e12cf28ea91d34ba45360e8bdf9c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73027544, jitterRate=0.08819520473480225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:42,304 DEBUG [Listener at localhost/39285] regionserver.HRegion(964): Region open journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:42,351 DEBUG [Listener at localhost/39285] regionserver.HRegion(1603): Closing 3819e12cf28ea91d34ba45360e8bdf9c, disabling compactions & flushes 2023-02-19 20:00:42,351 INFO [Listener at localhost/39285] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,351 DEBUG [Listener at localhost/39285] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,351 DEBUG [Listener at localhost/39285] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. after waiting 0 ms 2023-02-19 20:00:42,351 DEBUG [Listener at localhost/39285] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,352 INFO [Listener at localhost/39285] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,352 DEBUG [Listener at localhost/39285] regionserver.HRegion(1557): Region close journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:42,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-19 20:00:42,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,358 INFO [Listener at localhost/39285] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836842362"}]},"ts":"1676836842362"} 2023-02-19 20:00:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:42,363 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-19 20:00:42,364 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-19 20:00:42,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, UNASSIGN}] 2023-02-19 20:00:42,366 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, UNASSIGN 2023-02-19 20:00:42,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3819e12cf28ea91d34ba45360e8bdf9c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,367 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676836842367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836842367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836842367"}]},"ts":"1676836842367"} 2023-02-19 20:00:42,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 3819e12cf28ea91d34ba45360e8bdf9c, server=jenkins-hbase4.apache.org,35947,1676836839827}] 2023-02-19 20:00:42,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:42,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3819e12cf28ea91d34ba45360e8bdf9c, disabling compactions & flushes 2023-02-19 20:00:42,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. after waiting 0 ms 2023-02-19 20:00:42,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:42,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c. 2023-02-19 20:00:42,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3819e12cf28ea91d34ba45360e8bdf9c: 2023-02-19 20:00:42,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,526 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3819e12cf28ea91d34ba45360e8bdf9c, regionState=CLOSED 2023-02-19 20:00:42,526 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676836842526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836842526"}]},"ts":"1676836842526"} 2023-02-19 20:00:42,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 20:00:42,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 3819e12cf28ea91d34ba45360e8bdf9c, server=jenkins-hbase4.apache.org,35947,1676836839827 in 159 msec 2023-02-19 20:00:42,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 20:00:42,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3819e12cf28ea91d34ba45360e8bdf9c, UNASSIGN in 163 msec 2023-02-19 20:00:42,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836842530"}]},"ts":"1676836842530"} 2023-02-19 20:00:42,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-19 20:00:42,533 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-19 20:00:42,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-19 20:00:42,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:42,665 INFO [Listener at localhost/39285] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-19 20:00:42,666 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,668 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:42,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,673 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1, FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2, FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/recovered.edits] 2023-02-19 20:00:42,676 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/1ef55aec400340a2b234670d848d17fc to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/archive/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/1ef55aec400340a2b234670d848d17fc 2023-02-19 20:00:42,677 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/ad0a0052e52c42ac8fb0ea0f81be9410 to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/archive/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f1/ad0a0052e52c42ac8fb0ea0f81be9410 2023-02-19 20:00:42,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/07d40988fb62498ab7cb860fc04d5c3e to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/archive/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/07d40988fb62498ab7cb860fc04d5c3e 2023-02-19 20:00:42,680 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/3831f2260434466dadd9414e6a65d7df to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/archive/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/f2/3831f2260434466dadd9414e6a65d7df 2023-02-19 20:00:42,682 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/recovered.edits/12.seqid to hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/archive/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c/recovered.edits/12.seqid 2023-02-19 20:00:42,682 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/.tmp/data/default/testWithMockedMapReduceSingleRegion/3819e12cf28ea91d34ba45360e8bdf9c 2023-02-19 20:00:42,682 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-19 20:00:42,684 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,685 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-19 20:00:42,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-19 20:00:42,687 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,687 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-19 20:00:42,687 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836842687"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:42,688 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 20:00:42,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3819e12cf28ea91d34ba45360e8bdf9c, NAME => 'testWithMockedMapReduceSingleRegion,,1676836840869.3819e12cf28ea91d34ba45360e8bdf9c.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 20:00:42,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-19 20:00:42,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676836842688"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:42,689 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-19 20:00:42,691 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 20:00:42,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 25 msec 2023-02-19 20:00:42,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38279] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:42,771 INFO [Listener at localhost/39285] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-19 20:00:42,771 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:42,771 INFO [Listener at localhost/39285] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:42,772 DEBUG [Listener at localhost/39285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43a19780 to 127.0.0.1:58449 2023-02-19 20:00:42,772 DEBUG [Listener at localhost/39285] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,772 DEBUG [Listener at localhost/39285] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:42,772 DEBUG [Listener at localhost/39285] util.JVMClusterUtil(257): Found active master hash=549975566, stopped=false 2023-02-19 20:00:42,772 INFO [Listener at localhost/39285] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:42,774 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:42,774 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:42,774 INFO [Listener at localhost/39285] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:42,774 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:42,774 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:42,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:42,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:42,776 DEBUG [Listener at localhost/39285] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0db8f352 to 127.0.0.1:58449 2023-02-19 20:00:42,776 DEBUG [Listener at localhost/39285] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:42,776 INFO [Listener at localhost/39285] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40095,1676836839802' ***** 2023-02-19 20:00:42,776 INFO [Listener at localhost/39285] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:42,776 INFO [Listener at localhost/39285] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35947,1676836839827' ***** 2023-02-19 20:00:42,776 INFO [Listener at localhost/39285] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:42,776 INFO [RS:0;jenkins-hbase4:40095] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:42,776 INFO [RS:1;jenkins-hbase4:35947] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:42,776 INFO [RS:0;jenkins-hbase4:40095] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:42,777 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:42,777 INFO [RS:0;jenkins-hbase4:40095] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:42,777 INFO [RS:1;jenkins-hbase4:35947] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:42,778 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,778 INFO [RS:1;jenkins-hbase4:35947] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:42,777 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:42,778 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(3304): Received CLOSE for f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:42,778 DEBUG [RS:0;jenkins-hbase4:40095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0494a544 to 127.0.0.1:58449 2023-02-19 20:00:42,779 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,779 DEBUG [RS:0;jenkins-hbase4:40095] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,779 DEBUG [RS:1;jenkins-hbase4:35947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x106d4e93 to 127.0.0.1:58449 2023-02-19 20:00:42,779 INFO [RS:0;jenkins-hbase4:40095] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:42,779 INFO [RS:0;jenkins-hbase4:40095] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:42,779 INFO [RS:0;jenkins-hbase4:40095] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:42,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f84613ee8ed4e42ae617674d8532dce1, disabling compactions & flushes 2023-02-19 20:00:42,779 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:42,779 DEBUG [RS:1;jenkins-hbase4:35947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:42,779 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 20:00:42,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:42,779 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1479): Online Regions={f84613ee8ed4e42ae617674d8532dce1=hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1.} 2023-02-19 20:00:42,779 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 20:00:42,779 DEBUG [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1505): Waiting on f84613ee8ed4e42ae617674d8532dce1 2023-02-19 20:00:42,779 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 20:00:42,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. after waiting 0 ms 2023-02-19 20:00:42,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:42,779 DEBUG [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 20:00:42,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:42,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing f84613ee8ed4e42ae617674d8532dce1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:42,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:42,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:42,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:42,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:42,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-19 20:00:42,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/.tmp/info/6597501b3f524758af6506eb99586e63 2023-02-19 20:00:42,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/.tmp/info/6d768f9404ad441eae9b1bc9dcafbb82 2023-02-19 20:00:42,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d768f9404ad441eae9b1bc9dcafbb82 2023-02-19 20:00:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/.tmp/info/6597501b3f524758af6506eb99586e63 as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/info/6597501b3f524758af6506eb99586e63 2023-02-19 20:00:42,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/info/6597501b3f524758af6506eb99586e63, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:42,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f84613ee8ed4e42ae617674d8532dce1 in 24ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:42,804 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/.tmp/rep_barrier/e4a11038d01241908b5c69477a7ae6c5 2023-02-19 20:00:42,806 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:42,806 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:42,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/namespace/f84613ee8ed4e42ae617674d8532dce1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:42,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:42,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f84613ee8ed4e42ae617674d8532dce1: 2023-02-19 20:00:42,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836840378.f84613ee8ed4e42ae617674d8532dce1. 2023-02-19 20:00:42,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4a11038d01241908b5c69477a7ae6c5 2023-02-19 20:00:42,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/.tmp/table/a8ae42909b664f8c9835fcd65a11bb58 2023-02-19 20:00:42,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8ae42909b664f8c9835fcd65a11bb58 2023-02-19 20:00:42,820 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/.tmp/info/6d768f9404ad441eae9b1bc9dcafbb82 as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/info/6d768f9404ad441eae9b1bc9dcafbb82 2023-02-19 20:00:42,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d768f9404ad441eae9b1bc9dcafbb82 2023-02-19 20:00:42,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/info/6d768f9404ad441eae9b1bc9dcafbb82, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 20:00:42,825 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/.tmp/rep_barrier/e4a11038d01241908b5c69477a7ae6c5 as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/rep_barrier/e4a11038d01241908b5c69477a7ae6c5 2023-02-19 20:00:42,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4a11038d01241908b5c69477a7ae6c5 2023-02-19 20:00:42,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/rep_barrier/e4a11038d01241908b5c69477a7ae6c5, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 20:00:42,829 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/.tmp/table/a8ae42909b664f8c9835fcd65a11bb58 as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/table/a8ae42909b664f8c9835fcd65a11bb58 2023-02-19 20:00:42,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8ae42909b664f8c9835fcd65a11bb58 2023-02-19 20:00:42,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/table/a8ae42909b664f8c9835fcd65a11bb58, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 20:00:42,836 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false 2023-02-19 20:00:42,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 20:00:42,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:42,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:42,840 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:42,840 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:42,979 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35947,1676836839827; all regions closed. 2023-02-19 20:00:42,979 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40095,1676836839802; all regions closed. 2023-02-19 20:00:42,983 DEBUG [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/oldWALs 2023-02-19 20:00:42,983 INFO [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40095%2C1676836839802.meta:.meta(num 1676836840334) 2023-02-19 20:00:42,983 DEBUG [RS:1;jenkins-hbase4:35947] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/oldWALs 2023-02-19 20:00:42,983 INFO [RS:1;jenkins-hbase4:35947] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35947%2C1676836839827:(num 1676836840718) 2023-02-19 20:00:42,984 DEBUG [RS:1;jenkins-hbase4:35947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,984 INFO [RS:1;jenkins-hbase4:35947] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:42,984 INFO [RS:1;jenkins-hbase4:35947] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:42,984 INFO [RS:1;jenkins-hbase4:35947] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:42,984 INFO [RS:1;jenkins-hbase4:35947] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:42,984 INFO [RS:1;jenkins-hbase4:35947] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:42,984 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:42,985 INFO [RS:1;jenkins-hbase4:35947] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35947 2023-02-19 20:00:42,987 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:42,987 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,987 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:42,987 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35947,1676836839827 2023-02-19 20:00:42,987 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65d5f62d rejected from java.util.concurrent.ThreadPoolExecutor@61ea6e4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:42,987 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:42,987 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f282e49 rejected from java.util.concurrent.ThreadPoolExecutor@61ea6e4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:42,988 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35947,1676836839827] 2023-02-19 20:00:42,988 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35947,1676836839827; numProcessing=1 2023-02-19 20:00:42,988 DEBUG [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/oldWALs 2023-02-19 20:00:42,988 INFO [RS:0;jenkins-hbase4:40095] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40095%2C1676836839802:(num 1676836841131) 2023-02-19 20:00:42,988 DEBUG [RS:0;jenkins-hbase4:40095] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,988 INFO [RS:0;jenkins-hbase4:40095] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:42,989 INFO [RS:0;jenkins-hbase4:40095] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:42,989 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:42,990 INFO [RS:0;jenkins-hbase4:40095] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40095 2023-02-19 20:00:42,990 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35947,1676836839827 already deleted, retry=false 2023-02-19 20:00:42,991 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35947,1676836839827 expired; onlineServers=1 2023-02-19 20:00:42,991 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:42,991 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40095,1676836839802 2023-02-19 20:00:42,991 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79c46e9f rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:42,991 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40095,1676836839802] 2023-02-19 20:00:42,992 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40095,1676836839802; numProcessing=2 2023-02-19 20:00:42,993 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40095,1676836839802 already deleted, retry=false 2023-02-19 20:00:42,993 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40095,1676836839802 expired; onlineServers=0 2023-02-19 20:00:42,994 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38279,1676836839701' ***** 2023-02-19 20:00:42,994 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:42,994 DEBUG [M:0;jenkins-hbase4:38279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24f866ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:42,994 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38279,1676836839701 2023-02-19 20:00:42,994 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38279,1676836839701; all regions closed. 2023-02-19 20:00:42,994 DEBUG [M:0;jenkins-hbase4:38279] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:42,994 DEBUG [M:0;jenkins-hbase4:38279] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:42,995 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:42,995 DEBUG [M:0;jenkins-hbase4:38279] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836839989] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836839989,5,FailOnTimeoutGroup] 2023-02-19 20:00:42,995 INFO [M:0;jenkins-hbase4:38279] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:42,995 INFO [M:0;jenkins-hbase4:38279] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:42,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836839989] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836839989,5,FailOnTimeoutGroup] 2023-02-19 20:00:42,996 INFO [M:0;jenkins-hbase4:38279] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:42,996 DEBUG [M:0;jenkins-hbase4:38279] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:42,996 INFO [M:0;jenkins-hbase4:38279] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:42,997 ERROR [M:0;jenkins-hbase4:38279] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 20:00:42,997 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:42,997 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:42,997 INFO [M:0;jenkins-hbase4:38279] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:42,997 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:42,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:42,997 DEBUG [M:0;jenkins-hbase4:38279] zookeeper.ZKUtil(398): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:42,997 WARN [M:0;jenkins-hbase4:38279] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:42,997 INFO [M:0;jenkins-hbase4:38279] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:42,998 INFO [M:0;jenkins-hbase4:38279] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:42,998 DEBUG [M:0;jenkins-hbase4:38279] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:42,998 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:42,998 DEBUG [M:0;jenkins-hbase4:38279] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:42,998 DEBUG [M:0;jenkins-hbase4:38279] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:42,998 DEBUG [M:0;jenkins-hbase4:38279] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:42,998 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.06 KB 2023-02-19 20:00:43,006 INFO [M:0;jenkins-hbase4:38279] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/41991d3846e54b44a89639b27922bc5f 2023-02-19 20:00:43,010 DEBUG [M:0;jenkins-hbase4:38279] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/41991d3846e54b44a89639b27922bc5f as hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/41991d3846e54b44a89639b27922bc5f 2023-02-19 20:00:43,013 INFO [M:0;jenkins-hbase4:38279] regionserver.HStore(1080): Added hdfs://localhost:43177/user/jenkins/test-data/eda1b90d-15c8-b114-d51e-44f3a9a3201e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/41991d3846e54b44a89639b27922bc5f, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 20:00:43,014 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57474, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-19 20:00:43,014 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:43,014 DEBUG [M:0;jenkins-hbase4:38279] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:43,016 INFO [M:0;jenkins-hbase4:38279] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:43,016 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:43,017 INFO [M:0;jenkins-hbase4:38279] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38279 2023-02-19 20:00:43,019 DEBUG [M:0;jenkins-hbase4:38279] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38279,1676836839701 already deleted, retry=false 2023-02-19 20:00:43,274 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:43,274 INFO [M:0;jenkins-hbase4:38279] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38279,1676836839701; zookeeper connection closed. 2023-02-19 20:00:43,274 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c9e570a rejected from java.util.concurrent.ThreadPoolExecutor@48a1da41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:43,275 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): master:38279-0x1006e2b8ac50000, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:43,275 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27cb58d rejected from java.util.concurrent.ThreadPoolExecutor@48a1da41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:43,374 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:43,374 INFO [RS:0;jenkins-hbase4:40095] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40095,1676836839802; zookeeper connection closed. 2023-02-19 20:00:43,374 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5361e642 rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:43,375 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:40095-0x1006e2b8ac50001, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:43,375 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2bf90674 rejected from java.util.concurrent.ThreadPoolExecutor@7dfbe57f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:43,375 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e838438] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e838438 2023-02-19 20:00:43,475 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:43,475 INFO [RS:1;jenkins-hbase4:35947] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35947,1676836839827; zookeeper connection closed. 2023-02-19 20:00:43,475 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@272c53e6 rejected from java.util.concurrent.ThreadPoolExecutor@61ea6e4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:43,477 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@384cc477] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@384cc477 2023-02-19 20:00:43,477 DEBUG [Listener at localhost/39285-EventThread] zookeeper.ZKWatcher(600): regionserver:35947-0x1006e2b8ac50002, quorum=127.0.0.1:58449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:43,477 ERROR [Listener at localhost/39285-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a8337ee rejected from java.util.concurrent.ThreadPoolExecutor@61ea6e4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:43,477 INFO [Listener at localhost/39285] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:43,478 WARN [Listener at localhost/39285] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:43,483 INFO [Listener at localhost/39285] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:43,591 WARN [BP-885638913-172.31.14.131-1676836836664 heartbeating to localhost/127.0.0.1:43177] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:43,591 WARN [BP-885638913-172.31.14.131-1676836836664 heartbeating to localhost/127.0.0.1:43177] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-885638913-172.31.14.131-1676836836664 (Datanode Uuid d9e3f87b-ca4f-49fd-bfc0-b7569cad59ae) service to localhost/127.0.0.1:43177 2023-02-19 20:00:43,592 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/dfs/data/data3/current/BP-885638913-172.31.14.131-1676836836664] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:43,592 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/dfs/data/data4/current/BP-885638913-172.31.14.131-1676836836664] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:43,593 WARN [Listener at localhost/39285] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:43,596 INFO [Listener at localhost/39285] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:43,697 WARN [BP-885638913-172.31.14.131-1676836836664 heartbeating to localhost/127.0.0.1:43177] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:43,697 WARN [BP-885638913-172.31.14.131-1676836836664 heartbeating to localhost/127.0.0.1:43177] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-885638913-172.31.14.131-1676836836664 (Datanode Uuid d95dce95-dd6f-4c74-afae-2e07dbc44cf8) service to localhost/127.0.0.1:43177 2023-02-19 20:00:43,698 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/dfs/data/data1/current/BP-885638913-172.31.14.131-1676836836664] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:43,698 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/cluster_3d55a873-69a9-d90a-1deb-cfea8e4daa4b/dfs/data/data2/current/BP-885638913-172.31.14.131-1676836836664] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:43,709 INFO [Listener at localhost/39285] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:43,822 INFO [Listener at localhost/39285] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:43,841 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:43,854 INFO [Listener at localhost/39285] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=257 (was 232) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43177 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38279,1676836839701)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/39285 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:43177 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39285.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43177 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43177 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:43177 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=652 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=473 (was 496), ProcessCount=170 (was 170), AvailableMemoryMB=8949 (was 8987) 2023-02-19 20:00:43,865 INFO [Listener at localhost/39285] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=257, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=473, ProcessCount=170, AvailableMemoryMB=8948 2023-02-19 20:00:43,878 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/hadoop.log.dir so I do NOT create it in target/test-data/6c41bac1-2208-9646-169f-95e6452feb75 2023-02-19 20:00:43,878 WARN [Listener at localhost/39285] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 20:00:43,878 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/hadoop.tmp.dir so I do NOT create it in target/test-data/6c41bac1-2208-9646-169f-95e6452feb75 2023-02-19 20:00:43,878 WARN [Listener at localhost/39285] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58075607-e1cc-ca93-1f0d-57cb51a4c9a8/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 20:00:43,878 DEBUG [Listener at localhost/39285] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75 2023-02-19 20:00:43,878 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:00:43,878 INFO [Listener at localhost/39285] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5, deleteOnExit=true 2023-02-19 20:00:43,879 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:00:43,879 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/test.cache.data in system properties and HBase conf 2023-02-19 20:00:43,879 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:00:43,879 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:00:43,879 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:00:43,879 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:00:43,880 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:00:43,880 DEBUG [Listener at localhost/39285] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:00:43,880 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:43,880 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:43,880 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:00:43,880 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:00:43,881 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:00:43,882 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:43,882 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:00:43,882 INFO [Listener at localhost/39285] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:00:43,886 WARN [Listener at localhost/39285] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:43,887 WARN [Listener at localhost/39285] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:43,930 WARN [Listener at localhost/39285] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:43,933 INFO [Listener at localhost/39285] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:43,937 INFO [Listener at localhost/39285] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/java.io.tmpdir/Jetty_localhost_39047_hdfs____.bk8lvt/webapp 2023-02-19 20:00:44,035 INFO [Listener at localhost/39285] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39047 2023-02-19 20:00:44,040 WARN [Listener at localhost/39285] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:44,040 WARN [Listener at localhost/39285] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:44,087 WARN [Listener at localhost/36449] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:44,099 WARN [Listener at localhost/36449] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:44,101 WARN [Listener at localhost/36449] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:44,102 INFO [Listener at localhost/36449] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:44,107 INFO [Listener at localhost/36449] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/java.io.tmpdir/Jetty_localhost_33741_datanode____umjji3/webapp 2023-02-19 20:00:44,210 INFO [Listener at localhost/36449] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33741 2023-02-19 20:00:44,259 WARN [Listener at localhost/42993] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:44,271 WARN [Listener at localhost/42993] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:44,272 WARN [Listener at localhost/42993] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:44,273 INFO [Listener at localhost/42993] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:44,276 INFO [Listener at localhost/42993] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/java.io.tmpdir/Jetty_localhost_36561_datanode____9qo5hw/webapp 2023-02-19 20:00:44,347 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf4d739b3f208bd2c: Processing first storage report for DS-88e6d651-965c-4c66-b131-87eb25d7e8a1 from datanode 59360058-b669-4040-838f-0edbb01903a4 2023-02-19 20:00:44,347 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf4d739b3f208bd2c: from storage DS-88e6d651-965c-4c66-b131-87eb25d7e8a1 node DatanodeRegistration(127.0.0.1:40667, datanodeUuid=59360058-b669-4040-838f-0edbb01903a4, infoPort=44989, infoSecurePort=0, ipcPort=42993, storageInfo=lv=-57;cid=testClusterID;nsid=674677576;c=1676836843889), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:44,347 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf4d739b3f208bd2c: Processing first storage report for DS-27af3c54-7c78-417f-9201-cb8452ab91ee from datanode 59360058-b669-4040-838f-0edbb01903a4 2023-02-19 20:00:44,348 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf4d739b3f208bd2c: from storage DS-27af3c54-7c78-417f-9201-cb8452ab91ee node DatanodeRegistration(127.0.0.1:40667, datanodeUuid=59360058-b669-4040-838f-0edbb01903a4, infoPort=44989, infoSecurePort=0, ipcPort=42993, storageInfo=lv=-57;cid=testClusterID;nsid=674677576;c=1676836843889), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:44,376 INFO [Listener at localhost/42993] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36561 2023-02-19 20:00:44,383 WARN [Listener at localhost/34879] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:44,481 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x10daae3a5585ce85: Processing first storage report for DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c from datanode 418a1661-5d98-4f71-9fe0-21d3d9deb7a5 2023-02-19 20:00:44,481 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x10daae3a5585ce85: from storage DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c node DatanodeRegistration(127.0.0.1:33283, datanodeUuid=418a1661-5d98-4f71-9fe0-21d3d9deb7a5, infoPort=34889, infoSecurePort=0, ipcPort=34879, storageInfo=lv=-57;cid=testClusterID;nsid=674677576;c=1676836843889), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:44,481 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x10daae3a5585ce85: Processing first storage report for DS-a332397c-2425-4d47-b761-646fe9218b63 from datanode 418a1661-5d98-4f71-9fe0-21d3d9deb7a5 2023-02-19 20:00:44,481 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x10daae3a5585ce85: from storage DS-a332397c-2425-4d47-b761-646fe9218b63 node DatanodeRegistration(127.0.0.1:33283, datanodeUuid=418a1661-5d98-4f71-9fe0-21d3d9deb7a5, infoPort=34889, infoSecurePort=0, ipcPort=34879, storageInfo=lv=-57;cid=testClusterID;nsid=674677576;c=1676836843889), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:44,491 DEBUG [Listener at localhost/34879] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75 2023-02-19 20:00:44,493 INFO [Listener at localhost/34879] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/zookeeper_0, clientPort=56069, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:00:44,494 INFO [Listener at localhost/34879] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56069 2023-02-19 20:00:44,494 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,495 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,508 INFO [Listener at localhost/34879] util.FSUtils(479): Created version file at hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83 with version=8 2023-02-19 20:00:44,508 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,509 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,510 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36449/user/jenkins/test-data/e54ce7d7-8a72-a638-6f15-14862a022f3b/hbase-staging 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:44,512 INFO [Listener at localhost/34879] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:44,514 INFO [Listener at localhost/34879] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38051 2023-02-19 20:00:44,514 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,515 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,516 INFO [Listener at localhost/34879] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38051 connecting to ZooKeeper ensemble=127.0.0.1:56069 2023-02-19 20:00:44,522 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:380510x0, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:44,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38051-0x1006e2b9d910000 connected 2023-02-19 20:00:44,536 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:44,537 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:44,537 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:44,537 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38051 2023-02-19 20:00:44,538 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38051 2023-02-19 20:00:44,538 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38051 2023-02-19 20:00:44,538 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38051 2023-02-19 20:00:44,538 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38051 2023-02-19 20:00:44,538 INFO [Listener at localhost/34879] master.HMaster(444): hbase.rootdir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83, hbase.cluster.distributed=false 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:44,551 INFO [Listener at localhost/34879] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:44,552 INFO [Listener at localhost/34879] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42491 2023-02-19 20:00:44,552 INFO [Listener at localhost/34879] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:44,553 DEBUG [Listener at localhost/34879] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:44,553 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,554 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,555 INFO [Listener at localhost/34879] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42491 connecting to ZooKeeper ensemble=127.0.0.1:56069 2023-02-19 20:00:44,556 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:424910x0, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:44,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42491-0x1006e2b9d910001 connected 2023-02-19 20:00:44,558 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:44,558 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:44,559 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:44,559 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42491 2023-02-19 20:00:44,559 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42491 2023-02-19 20:00:44,561 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42491 2023-02-19 20:00:44,561 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42491 2023-02-19 20:00:44,561 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42491 2023-02-19 20:00:44,572 INFO [Listener at localhost/34879] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:44,572 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,573 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,573 INFO [Listener at localhost/34879] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:44,573 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:44,573 INFO [Listener at localhost/34879] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:44,573 INFO [Listener at localhost/34879] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:44,574 INFO [Listener at localhost/34879] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34301 2023-02-19 20:00:44,574 INFO [Listener at localhost/34879] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:44,574 DEBUG [Listener at localhost/34879] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:44,575 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,576 INFO [Listener at localhost/34879] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,577 INFO [Listener at localhost/34879] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34301 connecting to ZooKeeper ensemble=127.0.0.1:56069 2023-02-19 20:00:44,581 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:343010x0, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:44,581 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): regionserver:343010x0, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:44,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34301-0x1006e2b9d910002 connected 2023-02-19 20:00:44,583 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:44,583 DEBUG [Listener at localhost/34879] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:44,584 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34301 2023-02-19 20:00:44,584 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34301 2023-02-19 20:00:44,584 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34301 2023-02-19 20:00:44,585 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34301 2023-02-19 20:00:44,585 DEBUG [Listener at localhost/34879] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34301 2023-02-19 20:00:44,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,588 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:44,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,589 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:44,590 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:44,590 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,590 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:44,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:44,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:44,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38051,1676836844511 from backup master directory 2023-02-19 20:00:44,595 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,595 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:44,595 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:44,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/hbase.id with ID: 3706aa68-1989-405c-bb2e-cd1841a9f91b 2023-02-19 20:00:44,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:44,621 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0b78c8ec to 127.0.0.1:56069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:44,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ae23d02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:44,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:44,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:44,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:44,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store-tmp 2023-02-19 20:00:44,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:44,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:44,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:44,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:44,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:44,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:44,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:44,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:44,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/WALs/jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38051%2C1676836844511, suffix=, logDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/WALs/jenkins-hbase4.apache.org,38051,1676836844511, archiveDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:44,687 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK] 2023-02-19 20:00:44,687 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK] 2023-02-19 20:00:44,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/WALs/jenkins-hbase4.apache.org,38051,1676836844511/jenkins-hbase4.apache.org%2C38051%2C1676836844511.1676836844670 2023-02-19 20:00:44,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK], DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK]] 2023-02-19 20:00:44,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:44,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:44,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:44,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:44,691 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:44,692 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:44,693 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:44,693 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:44,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:44,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:44,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:44,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:44,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63269515, jitterRate=-0.057210758328437805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:44,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:44,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:44,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:44,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:44,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:44,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 20:00:44,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 20:00:44,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:44,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:44,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:44,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:44,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:44,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:44,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:44,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:44,717 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:44,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:44,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:44,720 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:44,720 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:44,720 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:44,720 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38051,1676836844511, sessionid=0x1006e2b9d910000, setting cluster-up flag (Was=false) 2023-02-19 20:00:44,727 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:44,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,734 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:44,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:44,741 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.hbase-snapshot/.tmp 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:44,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836874749 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:44,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,750 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:44,750 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:44,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:44,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:44,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:44,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:44,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:44,752 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:44,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836844752,5,FailOnTimeoutGroup] 2023-02-19 20:00:44,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836844758,5,FailOnTimeoutGroup] 2023-02-19 20:00:44,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:44,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,771 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:44,771 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:44,771 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83 2023-02-19 20:00:44,782 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:44,785 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:44,786 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/info 2023-02-19 20:00:44,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:44,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:44,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:44,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:44,788 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:44,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:44,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:44,789 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(952): ClusterId : 3706aa68-1989-405c-bb2e-cd1841a9f91b 2023-02-19 20:00:44,789 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:44,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/table 2023-02-19 20:00:44,789 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:44,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:44,790 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:44,791 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:44,793 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740 2023-02-19 20:00:44,794 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740 2023-02-19 20:00:44,794 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(952): ClusterId : 3706aa68-1989-405c-bb2e-cd1841a9f91b 2023-02-19 20:00:44,794 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:44,795 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:44,796 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:44,796 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:44,796 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:44,798 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:44,798 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:44,801 DEBUG [RS:0;jenkins-hbase4:42491] zookeeper.ReadOnlyZKClient(139): Connect 0x0344a73d to 127.0.0.1:56069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:44,801 DEBUG [RS:1;jenkins-hbase4:34301] zookeeper.ReadOnlyZKClient(139): Connect 0x63ed78d7 to 127.0.0.1:56069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:44,804 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:44,804 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73762020, jitterRate=0.0991397500038147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:44,804 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:44,804 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:44,804 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:44,804 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:44,804 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:44,804 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:44,816 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:44,816 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:44,817 DEBUG [RS:0;jenkins-hbase4:42491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d834925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:44,817 DEBUG [RS:0;jenkins-hbase4:42491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9bccc4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:44,817 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:44,817 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:44,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:44,822 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:44,824 DEBUG [RS:1;jenkins-hbase4:34301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d2a8ada, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:44,824 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:44,824 DEBUG [RS:1;jenkins-hbase4:34301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@691513a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:44,831 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42491 2023-02-19 20:00:44,831 INFO [RS:0;jenkins-hbase4:42491] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:44,831 INFO [RS:0;jenkins-hbase4:42491] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:44,831 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:44,832 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38051,1676836844511 with isa=jenkins-hbase4.apache.org/172.31.14.131:42491, startcode=1676836844550 2023-02-19 20:00:44,832 DEBUG [RS:0;jenkins-hbase4:42491] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:44,834 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44765, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:44,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,837 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83 2023-02-19 20:00:44,837 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36449 2023-02-19 20:00:44,837 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:44,837 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34301 2023-02-19 20:00:44,837 INFO [RS:1;jenkins-hbase4:34301] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:44,837 INFO [RS:1;jenkins-hbase4:34301] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:44,837 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:44,839 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:44,839 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38051,1676836844511 with isa=jenkins-hbase4.apache.org/172.31.14.131:34301, startcode=1676836844572 2023-02-19 20:00:44,839 DEBUG [RS:1;jenkins-hbase4:34301] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:44,840 DEBUG [RS:0;jenkins-hbase4:42491] zookeeper.ZKUtil(162): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,840 WARN [RS:0;jenkins-hbase4:42491] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:44,840 INFO [RS:0;jenkins-hbase4:42491] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:44,840 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,841 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42491,1676836844550] 2023-02-19 20:00:44,841 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53819, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:44,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,843 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83 2023-02-19 20:00:44,843 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36449 2023-02-19 20:00:44,843 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:44,848 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:44,848 DEBUG [RS:1;jenkins-hbase4:34301] zookeeper.ZKUtil(162): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,848 WARN [RS:1;jenkins-hbase4:34301] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:44,848 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34301,1676836844572] 2023-02-19 20:00:44,848 INFO [RS:1;jenkins-hbase4:34301] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:44,848 DEBUG [RS:0;jenkins-hbase4:42491] zookeeper.ZKUtil(162): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,848 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,849 DEBUG [RS:0;jenkins-hbase4:42491] zookeeper.ZKUtil(162): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,850 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:44,851 INFO [RS:0;jenkins-hbase4:42491] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:44,853 INFO [RS:0;jenkins-hbase4:42491] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:44,853 DEBUG [RS:1;jenkins-hbase4:34301] zookeeper.ZKUtil(162): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,854 DEBUG [RS:1;jenkins-hbase4:34301] zookeeper.ZKUtil(162): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,855 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:44,855 INFO [RS:1;jenkins-hbase4:34301] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:44,856 INFO [RS:0;jenkins-hbase4:42491] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:44,856 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,856 INFO [RS:1;jenkins-hbase4:34301] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:44,856 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:44,857 INFO [RS:1;jenkins-hbase4:34301] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:44,857 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,857 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:44,858 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,858 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,858 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,859 DEBUG [RS:0;jenkins-hbase4:42491] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,860 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,860 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,861 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,861 DEBUG [RS:1;jenkins-hbase4:34301] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:44,868 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,868 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,868 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,880 INFO [RS:0;jenkins-hbase4:42491] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:44,880 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42491,1676836844550-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,882 INFO [RS:1;jenkins-hbase4:34301] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:44,882 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34301,1676836844572-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:44,896 INFO [RS:0;jenkins-hbase4:42491] regionserver.Replication(203): jenkins-hbase4.apache.org,42491,1676836844550 started 2023-02-19 20:00:44,896 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42491,1676836844550, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42491, sessionid=0x1006e2b9d910001 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42491,1676836844550' 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:44,897 DEBUG [RS:0;jenkins-hbase4:42491] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42491,1676836844550' 2023-02-19 20:00:44,898 DEBUG [RS:0;jenkins-hbase4:42491] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:44,898 DEBUG [RS:0;jenkins-hbase4:42491] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:44,898 DEBUG [RS:0;jenkins-hbase4:42491] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:44,898 INFO [RS:0;jenkins-hbase4:42491] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:44,898 INFO [RS:0;jenkins-hbase4:42491] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:44,900 INFO [RS:1;jenkins-hbase4:34301] regionserver.Replication(203): jenkins-hbase4.apache.org,34301,1676836844572 started 2023-02-19 20:00:44,900 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34301,1676836844572, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34301, sessionid=0x1006e2b9d910002 2023-02-19 20:00:44,900 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:44,900 DEBUG [RS:1;jenkins-hbase4:34301] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,900 DEBUG [RS:1;jenkins-hbase4:34301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34301,1676836844572' 2023-02-19 20:00:44,900 DEBUG [RS:1;jenkins-hbase4:34301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:44,900 DEBUG [RS:1;jenkins-hbase4:34301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:44,900 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:44,901 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:44,901 DEBUG [RS:1;jenkins-hbase4:34301] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:44,901 DEBUG [RS:1;jenkins-hbase4:34301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34301,1676836844572' 2023-02-19 20:00:44,901 DEBUG [RS:1;jenkins-hbase4:34301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:44,901 DEBUG [RS:1;jenkins-hbase4:34301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:44,901 DEBUG [RS:1;jenkins-hbase4:34301] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:44,901 INFO [RS:1;jenkins-hbase4:34301] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:44,901 INFO [RS:1;jenkins-hbase4:34301] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:44,974 DEBUG [jenkins-hbase4:38051] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:44,974 DEBUG [jenkins-hbase4:38051] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:44,976 DEBUG [jenkins-hbase4:38051] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:44,976 DEBUG [jenkins-hbase4:38051] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:44,976 DEBUG [jenkins-hbase4:38051] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:44,976 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34301,1676836844572, state=OPENING 2023-02-19 20:00:44,977 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:44,978 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:44,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34301,1676836844572}] 2023-02-19 20:00:44,979 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:45,133 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:45,134 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:45,135 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:45,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:45,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:45,140 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34301%2C1676836844572.meta, suffix=.meta, logDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,34301,1676836844572, archiveDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/oldWALs, maxLogs=32 2023-02-19 20:00:45,152 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK] 2023-02-19 20:00:45,152 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK] 2023-02-19 20:00:45,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,34301,1676836844572/jenkins-hbase4.apache.org%2C34301%2C1676836844572.meta.1676836845140.meta 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK], DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK]] 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:45,154 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:45,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:45,155 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:45,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/info 2023-02-19 20:00:45,156 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/info 2023-02-19 20:00:45,156 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:45,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:45,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:45,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:45,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:45,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:45,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:45,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:45,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/table 2023-02-19 20:00:45,159 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/table 2023-02-19 20:00:45,159 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:45,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:45,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740 2023-02-19 20:00:45,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740 2023-02-19 20:00:45,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:45,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:45,163 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69811661, jitterRate=0.040274813771247864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:45,163 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:45,164 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836845133 2023-02-19 20:00:45,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:45,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:45,167 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34301,1676836844572, state=OPEN 2023-02-19 20:00:45,173 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:45,173 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:45,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:45,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34301,1676836844572 in 194 msec 2023-02-19 20:00:45,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:45,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-19 20:00:45,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 433 msec 2023-02-19 20:00:45,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836845176, completionTime=-1 2023-02-19 20:00:45,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:45,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:45,178 DEBUG [hconnection-0x1f1abaae-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:45,179 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:45,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:45,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836905181 2023-02-19 20:00:45,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836965181 2023-02-19 20:00:45,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38051,1676836844511-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38051,1676836844511-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38051,1676836844511-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38051, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:45,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:45,190 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:45,191 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:45,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:45,193 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,193 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe empty. 2023-02-19 20:00:45,193 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,193 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:45,201 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:45,201 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8cda856fdb288ed2892bd5f1f25246fe, NAME => 'hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp 2023-02-19 20:00:45,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:45,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8cda856fdb288ed2892bd5f1f25246fe, disabling compactions & flushes 2023-02-19 20:00:45,207 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. after waiting 0 ms 2023-02-19 20:00:45,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,207 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8cda856fdb288ed2892bd5f1f25246fe: 2023-02-19 20:00:45,208 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:45,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836845209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836845209"}]},"ts":"1676836845209"} 2023-02-19 20:00:45,210 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:45,211 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:45,211 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836845211"}]},"ts":"1676836845211"} 2023-02-19 20:00:45,212 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:45,216 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:45,216 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:45,216 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:45,217 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:45,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8cda856fdb288ed2892bd5f1f25246fe, ASSIGN}] 2023-02-19 20:00:45,219 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8cda856fdb288ed2892bd5f1f25246fe, ASSIGN 2023-02-19 20:00:45,219 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8cda856fdb288ed2892bd5f1f25246fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42491,1676836844550; forceNewPlan=false, retain=false 2023-02-19 20:00:45,370 INFO [jenkins-hbase4:38051] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:45,370 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8cda856fdb288ed2892bd5f1f25246fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:45,370 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836845370"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836845370"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836845370"}]},"ts":"1676836845370"} 2023-02-19 20:00:45,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8cda856fdb288ed2892bd5f1f25246fe, server=jenkins-hbase4.apache.org,42491,1676836844550}] 2023-02-19 20:00:45,524 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:45,524 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:45,526 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52350, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:45,529 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,530 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42491%2C1676836844550, suffix=, logDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,42491,1676836844550, archiveDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/oldWALs, maxLogs=32 2023-02-19 20:00:45,543 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK] 2023-02-19 20:00:45,544 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK] 2023-02-19 20:00:45,546 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,42491,1676836844550/jenkins-hbase4.apache.org%2C42491%2C1676836844550.1676836845530 2023-02-19 20:00:45,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK], DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK]] 2023-02-19 20:00:45,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8cda856fdb288ed2892bd5f1f25246fe, NAME => 'hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:45,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:45,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,548 INFO [StoreOpener-8cda856fdb288ed2892bd5f1f25246fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,550 DEBUG [StoreOpener-8cda856fdb288ed2892bd5f1f25246fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/info 2023-02-19 20:00:45,550 DEBUG [StoreOpener-8cda856fdb288ed2892bd5f1f25246fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/info 2023-02-19 20:00:45,550 INFO [StoreOpener-8cda856fdb288ed2892bd5f1f25246fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cda856fdb288ed2892bd5f1f25246fe columnFamilyName info 2023-02-19 20:00:45,551 INFO [StoreOpener-8cda856fdb288ed2892bd5f1f25246fe-1] regionserver.HStore(310): Store=8cda856fdb288ed2892bd5f1f25246fe/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:45,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:45,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:45,571 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8cda856fdb288ed2892bd5f1f25246fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75384212, jitterRate=0.12331229448318481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:45,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8cda856fdb288ed2892bd5f1f25246fe: 2023-02-19 20:00:45,572 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe., pid=6, masterSystemTime=1676836845524 2023-02-19 20:00:45,577 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,578 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:45,584 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8cda856fdb288ed2892bd5f1f25246fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:45,584 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836845584"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836845584"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836845584"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836845584"}]},"ts":"1676836845584"} 2023-02-19 20:00:45,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:45,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8cda856fdb288ed2892bd5f1f25246fe, server=jenkins-hbase4.apache.org,42491,1676836844550 in 215 msec 2023-02-19 20:00:45,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:45,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8cda856fdb288ed2892bd5f1f25246fe, ASSIGN in 371 msec 2023-02-19 20:00:45,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:45,593 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836845593"}]},"ts":"1676836845593"} 2023-02-19 20:00:45,595 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:45,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:45,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 411 msec 2023-02-19 20:00:45,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:45,692 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:45,692 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:45,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:45,696 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:45,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:45,704 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:45,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-19 20:00:45,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:45,714 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:45,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-19 20:00:45,723 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:45,725 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:45,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.130sec 2023-02-19 20:00:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38051,1676836844511-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:45,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38051,1676836844511-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:45,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:45,794 DEBUG [Listener at localhost/34879] zookeeper.ReadOnlyZKClient(139): Connect 0x7e68c6b4 to 127.0.0.1:56069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:45,797 DEBUG [Listener at localhost/34879] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ea71075, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:45,798 DEBUG [hconnection-0x6719cf5f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:45,800 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:45,801 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:45,801 DEBUG [Listener at localhost/34879] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:45,803 DEBUG [Listener at localhost/34879] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:45,805 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:45,805 INFO [Listener at localhost/34879] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:45,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:45,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:45,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:35318 deadline: 1676836905805, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:45,806 INFO [Listener at localhost/34879] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 20:00:45,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:45,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:45,810 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:45,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-19 20:00:45,811 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:45,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:45,812 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:45,812 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c empty. 2023-02-19 20:00:45,813 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:45,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-19 20:00:45,824 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:45,825 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => a92b2cb27785a1b56cc349c2e348b36c, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp 2023-02-19 20:00:45,832 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:45,832 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing a92b2cb27785a1b56cc349c2e348b36c, disabling compactions & flushes 2023-02-19 20:00:45,832 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:45,832 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:45,832 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. after waiting 0 ms 2023-02-19 20:00:45,832 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:45,832 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:45,832 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for a92b2cb27785a1b56cc349c2e348b36c: 2023-02-19 20:00:45,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:45,834 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676836845834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836845834"}]},"ts":"1676836845834"} 2023-02-19 20:00:45,836 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:45,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:45,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836845836"}]},"ts":"1676836845836"} 2023-02-19 20:00:45,837 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-19 20:00:45,841 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:45,842 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:45,842 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:45,842 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:45,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, ASSIGN}] 2023-02-19 20:00:45,844 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, ASSIGN 2023-02-19 20:00:45,845 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34301,1676836844572; forceNewPlan=false, retain=false 2023-02-19 20:00:45,852 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:45,903 INFO [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34301%2C1676836844572, suffix=, logDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,34301,1676836844572, archiveDir=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/oldWALs, maxLogs=32 2023-02-19 20:00:45,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:45,921 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK] 2023-02-19 20:00:45,921 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK] 2023-02-19 20:00:45,929 INFO [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/WALs/jenkins-hbase4.apache.org,34301,1676836844572/jenkins-hbase4.apache.org%2C34301%2C1676836844572.1676836845903 2023-02-19 20:00:45,932 DEBUG [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40667,DS-88e6d651-965c-4c66-b131-87eb25d7e8a1,DISK], DatanodeInfoWithStorage[127.0.0.1:33283,DS-c78bb0b8-5331-41bb-ac9f-634d60ed511c,DISK]] 2023-02-19 20:00:45,995 INFO [jenkins-hbase4:38051] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:45,995 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a92b2cb27785a1b56cc349c2e348b36c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:45,995 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676836845995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836845995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836845995"}]},"ts":"1676836845995"} 2023-02-19 20:00:45,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure a92b2cb27785a1b56cc349c2e348b36c, server=jenkins-hbase4.apache.org,34301,1676836844572}] 2023-02-19 20:00:46,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:46,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a92b2cb27785a1b56cc349c2e348b36c, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:46,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:46,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,153 INFO [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,154 DEBUG [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1 2023-02-19 20:00:46,154 DEBUG [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1 2023-02-19 20:00:46,154 INFO [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a92b2cb27785a1b56cc349c2e348b36c columnFamilyName f1 2023-02-19 20:00:46,155 INFO [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] regionserver.HStore(310): Store=a92b2cb27785a1b56cc349c2e348b36c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:46,155 INFO [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,156 DEBUG [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2 2023-02-19 20:00:46,156 DEBUG [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2 2023-02-19 20:00:46,156 INFO [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a92b2cb27785a1b56cc349c2e348b36c columnFamilyName f2 2023-02-19 20:00:46,156 INFO [StoreOpener-a92b2cb27785a1b56cc349c2e348b36c-1] regionserver.HStore(310): Store=a92b2cb27785a1b56cc349c2e348b36c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:46,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:46,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:46,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:46,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a92b2cb27785a1b56cc349c2e348b36c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65662431, jitterRate=-0.021553531289100647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:46,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a92b2cb27785a1b56cc349c2e348b36c: 2023-02-19 20:00:46,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c., pid=12, masterSystemTime=1676836846149 2023-02-19 20:00:46,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a92b2cb27785a1b56cc349c2e348b36c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,163 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676836846163"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836846163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836846163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836846163"}]},"ts":"1676836846163"} 2023-02-19 20:00:46,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 20:00:46,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure a92b2cb27785a1b56cc349c2e348b36c, server=jenkins-hbase4.apache.org,34301,1676836844572 in 167 msec 2023-02-19 20:00:46,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 20:00:46,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, ASSIGN in 324 msec 2023-02-19 20:00:46,167 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:46,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836846167"}]},"ts":"1676836846167"} 2023-02-19 20:00:46,168 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-19 20:00:46,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:46,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 362 msec 2023-02-19 20:00:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:46,416 INFO [Listener at localhost/34879] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-19 20:00:46,416 DEBUG [Listener at localhost/34879] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-19 20:00:46,416 INFO [Listener at localhost/34879] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:46,418 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-19 20:00:46,418 INFO [Listener at localhost/34879] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:46,418 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-19 20:00:46,418 INFO [Listener at localhost/34879] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:46,449 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34301] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,532 INFO [Listener at localhost/34879] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:46,532 INFO [Listener at localhost/34879] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:46,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 20:00:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836846533 (current time:1676836846533). 2023-02-19 20:00:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] zookeeper.ReadOnlyZKClient(139): Connect 0x2dbf6b18 to 127.0.0.1:56069 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:46,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f70df80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:46,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:46,538 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54270, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:46,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dbf6b18 to 127.0.0.1:56069 2023-02-19 20:00:46,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:46,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:46,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 20:00:46,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 20:00:46,542 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 20:00:46,542 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676837446542 2023-02-19 20:00:46,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 20:00:46,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:46,544 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:46,544 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:46,545 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 20:00:46,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 20:00:46,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-19 20:00:46,546 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 20:00:46,546 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676837446546 2023-02-19 20:00:46,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-19 20:00:46,553 INFO [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-19 20:00:46,554 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:46,554 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-19 20:00:46,554 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-19 20:00:46,555 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,555 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,556 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:46,556 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:46,556 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:46,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:46,556 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,556 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-19 20:00:46,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-19 20:00:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-19 20:00:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-19 20:00:46,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 20:00:46,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 20:00:46,557 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 20:00:46,557 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34301,1676836844572' joining acquired barrier for procedure (foo) in zk 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 20:00:46,558 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42491,1676836844550' joining acquired barrier for procedure (foo) in zk 2023-02-19 20:00:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,559 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:46,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:46,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:46,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34301,1676836844572' joining acquired barrier for procedure 'foo' on coordinator 2023-02-19 20:00:46,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b584968[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:46,561 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-19 20:00:46,561 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 20:00:46,564 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,564 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 20:00:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 20:00:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 20:00:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42491,1676836844550' in zk 2023-02-19 20:00:46,564 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:46,564 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. started... 2023-02-19 20:00:46,564 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a92b2cb27785a1b56cc349c2e348b36c 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 20:00:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 20:00:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 20:00:46,577 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f1/69e1da42a64a4f6b941b2c80b3aa839b 2023-02-19 20:00:46,593 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f2/9de3b54f842441598b76aaa35748862c 2023-02-19 20:00:46,596 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f1/69e1da42a64a4f6b941b2c80b3aa839b as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b 2023-02-19 20:00:46,600 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:46,600 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f2/9de3b54f842441598b76aaa35748862c as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c 2023-02-19 20:00:46,605 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:46,606 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for a92b2cb27785a1b56cc349c2e348b36c in 42ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:46,606 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a92b2cb27785a1b56cc349c2e348b36c: 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.' region-info for snapshot=foo 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b] hfiles 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b for snapshot=foo 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c] hfiles 2023-02-19 20:00:46,607 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c for snapshot=foo 2023-02-19 20:00:46,615 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. completed. 2023-02-19 20:00:46,615 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 20:00:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 20:00:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 20:00:46,615 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34301,1676836844572' in zk 2023-02-19 20:00:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 20:00:46,616 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:46,616 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 20:00:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34301,1676836844572': 2023-02-19 20:00:46,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34301,1676836844572' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-19 20:00:46,619 INFO [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-19 20:00:46,619 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:46,620 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:46,620 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-19 20:00:46,620 INFO [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:46,621 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:46,621 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:46,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,621 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:46,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:46,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:46,622 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,622 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:46,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:46,623 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 20:00:46,624 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,634 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:46,635 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-19 20:00:46,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:46,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:46,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 20:00:46,635 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 20:00:46,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:46,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.hbase-snapshot/.tmp/foo 2023-02-19 20:00:46,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:46,645 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:46,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-19 20:00:46,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:46,646 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:46,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.hbase-snapshot/.tmp/foo to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.hbase-snapshot/foo 2023-02-19 20:00:46,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-19 20:00:46,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.hbase-snapshot/.tmp/foo 2023-02-19 20:00:46,668 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.hbase-snapshot/.tmp/foo 2023-02-19 20:00:46,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676836846543Consolidate snapshot: foo at 1676836846635 (+92 ms)Loading Region manifests for foo at 1676836846635Writing data manifest for foo at 1676836846637 (+2 ms)Verifying snapshot: foo at 1676836846644 (+7 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676836846667 (+23 ms) 2023-02-19 20:00:46,669 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 20:00:46,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 125 msec 2023-02-19 20:00:46,846 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:46,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-19 20:00:46,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:46,847 INFO [Listener at localhost/34879] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:46,851 INFO [Listener at localhost/34879] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:46,855 INFO [Listener at localhost/34879] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:46,882 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34301] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:46,990 INFO [Listener at localhost/34879] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:46,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:46,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:46,997 INFO [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 20:00:46,997 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:46,998 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-19 20:00:46,998 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-19 20:00:46,998 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:46,998 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,000 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:47,000 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:47,000 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:47,000 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,000 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,002 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-19 20:00:47,002 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-19 20:00:47,002 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:47,002 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:47,002 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-19 20:00:47,003 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-19 20:00:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-19 20:00:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42491,1676836844550' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-19 20:00:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 20:00:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:47,004 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,004 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. started... 2023-02-19 20:00:47,004 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a92b2cb27785a1b56cc349c2e348b36c 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 20:00:47,005 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,005 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,005 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:47,019 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f1/eb586d5fc8a044c194a8bcabdda1ed4a 2023-02-19 20:00:47,035 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f2/85b11d668ec5491ca1c5571c7e27149b 2023-02-19 20:00:47,039 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f1/eb586d5fc8a044c194a8bcabdda1ed4a as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/eb586d5fc8a044c194a8bcabdda1ed4a 2023-02-19 20:00:47,042 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/eb586d5fc8a044c194a8bcabdda1ed4a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:47,042 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/.tmp/f2/85b11d668ec5491ca1c5571c7e27149b as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/85b11d668ec5491ca1c5571c7e27149b 2023-02-19 20:00:47,046 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/85b11d668ec5491ca1c5571c7e27149b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:47,047 INFO [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for a92b2cb27785a1b56cc349c2e348b36c in 43ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:47,048 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a92b2cb27785a1b56cc349c2e348b36c: 2023-02-19 20:00:47,048 DEBUG [rs(jenkins-hbase4.apache.org,34301,1676836844572)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 20:00:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 20:00:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-19 20:00:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34301,1676836844572' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-19 20:00:47,050 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:47,051 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,051 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:47,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:47,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:47,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:47,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34301,1676836844572' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-19 20:00:47,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f67d6db[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:47,052 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-19 20:00:47,052 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,054 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,054 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,054 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,054 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:47,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-19 20:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-19 20:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,42491,1676836844550' in zk 2023-02-19 20:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-19 20:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-19 20:00:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,34301,1676836844572' in zk 2023-02-19 20:00:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-19 20:00:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,42491,1676836844550' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-19 20:00:47,058 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-19 20:00:47,058 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:47,058 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,058 DEBUG [member: 'jenkins-hbase4.apache.org,34301,1676836844572' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-19 20:00:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,34301,1676836844572': 2023-02-19 20:00:47,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34301,1676836844572' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-19 20:00:47,061 INFO [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-19 20:00:47,061 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:47,061 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:47,061 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,061 INFO [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:47,062 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:47,062 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:47,062 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,062 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:47,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:47,063 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,063 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,064 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:47,065 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:47,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:47,068 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 20:00:47,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:47,068 DEBUG [(jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:47,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:47,069 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:47,069 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,069 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,069 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,069 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:47,069 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:47,169 DEBUG [Listener at localhost/34879] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:47,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:47,174 INFO [Listener at localhost/34879] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676836846533 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:47,174 DEBUG [Listener at localhost/34879] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36449/user/jenkins/test-data/e54ce7d7-8a72-a638-6f15-14862a022f3b/foo/7549ed21-4ff3-4350-976f-c730431fc0ce/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,175 INFO [Listener at localhost/34879] snapshot.RestoreSnapshotHelper(239): region to add: a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:47,175 INFO [Listener at localhost/34879] snapshot.RestoreSnapshotHelper(585): clone region=a92b2cb27785a1b56cc349c2e348b36c as a92b2cb27785a1b56cc349c2e348b36c in snapshot foo 2023-02-19 20:00:47,175 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => a92b2cb27785a1b56cc349c2e348b36c, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36449/user/jenkins/test-data/e54ce7d7-8a72-a638-6f15-14862a022f3b/foo/7549ed21-4ff3-4350-976f-c730431fc0ce 2023-02-19 20:00:47,181 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:47,181 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 69e1da42a64a4f6b941b2c80b3aa839b from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,183 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9de3b54f842441598b76aaa35748862c from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,185 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing a92b2cb27785a1b56cc349c2e348b36c, disabling compactions & flushes 2023-02-19 20:00:47,185 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,185 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,185 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. after waiting 0 ms 2023-02-19 20:00:47,185 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,185 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,185 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for a92b2cb27785a1b56cc349c2e348b36c: 2023-02-19 20:00:47,186 INFO [Listener at localhost/34879] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676836846533 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:47,186 DEBUG [Listener at localhost/34879] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36449/user/jenkins/test-data/e54ce7d7-8a72-a638-6f15-14862a022f3b/foo/7549ed21-4ff3-4350-976f-c730431fc0ce 2023-02-19 20:00:47,187 DEBUG [Listener at localhost/34879] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36449/user/jenkins/test-data/e54ce7d7-8a72-a638-6f15-14862a022f3b/foo/7549ed21-4ff3-4350-976f-c730431fc0ce 2023-02-19 20:00:47,187 DEBUG [Listener at localhost/34879] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:47,187 DEBUG [Listener at localhost/34879] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:47,188 DEBUG [Listener at localhost/34879] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-19 20:00:47,188 DEBUG [Listener at localhost/34879] util.CommonFSUtils(699): |----------a92b2cb27785a1b56cc349c2e348b36c/ 2023-02-19 20:00:47,188 DEBUG [Listener at localhost/34879] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:47,188 DEBUG [Listener at localhost/34879] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:47,189 DEBUG [Listener at localhost/34879] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=a92b2cb27785a1b56cc349c2e348b36c-69e1da42a64a4f6b941b2c80b3aa839b 2023-02-19 20:00:47,189 DEBUG [Listener at localhost/34879] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:47,189 DEBUG [Listener at localhost/34879] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=a92b2cb27785a1b56cc349c2e348b36c-9de3b54f842441598b76aaa35748862c hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/eb586d5fc8a044c194a8bcabdda1ed4a hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/85b11d668ec5491ca1c5571c7e27149b hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c 2023-02-19 20:00:47,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-19 20:00:47,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-19 20:00:47,197 INFO [Listener at localhost/34879] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:47,200 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836847200"}]},"ts":"1676836847200"} 2023-02-19 20:00:47,201 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-19 20:00:47,203 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-19 20:00:47,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, UNASSIGN}] 2023-02-19 20:00:47,207 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, UNASSIGN 2023-02-19 20:00:47,207 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a92b2cb27785a1b56cc349c2e348b36c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,207 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676836847207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836847207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836847207"}]},"ts":"1676836847207"} 2023-02-19 20:00:47,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure a92b2cb27785a1b56cc349c2e348b36c, server=jenkins-hbase4.apache.org,34301,1676836844572}] 2023-02-19 20:00:47,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:47,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:47,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a92b2cb27785a1b56cc349c2e348b36c, disabling compactions & flushes 2023-02-19 20:00:47,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. after waiting 0 ms 2023-02-19 20:00:47,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:47,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c. 2023-02-19 20:00:47,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a92b2cb27785a1b56cc349c2e348b36c: 2023-02-19 20:00:47,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:47,366 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a92b2cb27785a1b56cc349c2e348b36c, regionState=CLOSED 2023-02-19 20:00:47,366 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676836847366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836847366"}]},"ts":"1676836847366"} 2023-02-19 20:00:47,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 20:00:47,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure a92b2cb27785a1b56cc349c2e348b36c, server=jenkins-hbase4.apache.org,34301,1676836844572 in 158 msec 2023-02-19 20:00:47,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 20:00:47,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=a92b2cb27785a1b56cc349c2e348b36c, UNASSIGN in 165 msec 2023-02-19 20:00:47,370 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836847370"}]},"ts":"1676836847370"} 2023-02-19 20:00:47,371 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-19 20:00:47,373 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-19 20:00:47,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 177 msec 2023-02-19 20:00:47,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:47,503 INFO [Listener at localhost/34879] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-19 20:00:47,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,509 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:47,512 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:47,514 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1, FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2, FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/recovered.edits] 2023-02-19 20:00:47,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/69e1da42a64a4f6b941b2c80b3aa839b 2023-02-19 20:00:47,519 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/eb586d5fc8a044c194a8bcabdda1ed4a to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f1/eb586d5fc8a044c194a8bcabdda1ed4a 2023-02-19 20:00:47,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/85b11d668ec5491ca1c5571c7e27149b to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/85b11d668ec5491ca1c5571c7e27149b 2023-02-19 20:00:47,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/f2/9de3b54f842441598b76aaa35748862c 2023-02-19 20:00:47,528 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/recovered.edits/12.seqid to hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c/recovered.edits/12.seqid 2023-02-19 20:00:47,529 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/a92b2cb27785a1b56cc349c2e348b36c 2023-02-19 20:00:47,529 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-19 20:00:47,531 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,533 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-19 20:00:47,535 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-19 20:00:47,541 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,541 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-19 20:00:47,541 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836847541"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:47,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 20:00:47,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a92b2cb27785a1b56cc349c2e348b36c, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676836845808.a92b2cb27785a1b56cc349c2e348b36c.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 20:00:47,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-19 20:00:47,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676836847543"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:47,546 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-19 20:00:47,548 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 20:00:47,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 43 msec 2023-02-19 20:00:47,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:47,611 INFO [Listener at localhost/34879] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-19 20:00:47,611 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:47,611 INFO [Listener at localhost/34879] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:47,612 DEBUG [Listener at localhost/34879] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e68c6b4 to 127.0.0.1:56069 2023-02-19 20:00:47,612 DEBUG [Listener at localhost/34879] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,612 DEBUG [Listener at localhost/34879] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:47,612 DEBUG [Listener at localhost/34879] util.JVMClusterUtil(257): Found active master hash=1481639938, stopped=false 2023-02-19 20:00:47,612 INFO [Listener at localhost/34879] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:47,616 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:47,616 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:47,616 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:47,616 INFO [Listener at localhost/34879] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:47,616 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:47,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:47,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:47,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:47,618 DEBUG [Listener at localhost/34879] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b78c8ec to 127.0.0.1:56069 2023-02-19 20:00:47,618 DEBUG [Listener at localhost/34879] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,618 INFO [Listener at localhost/34879] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42491,1676836844550' ***** 2023-02-19 20:00:47,618 INFO [Listener at localhost/34879] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:47,618 INFO [Listener at localhost/34879] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34301,1676836844572' ***** 2023-02-19 20:00:47,618 INFO [Listener at localhost/34879] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:47,618 INFO [RS:1;jenkins-hbase4:34301] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:47,619 INFO [RS:1;jenkins-hbase4:34301] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:47,619 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:47,619 INFO [RS:1;jenkins-hbase4:34301] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:47,620 INFO [RS:0;jenkins-hbase4:42491] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:47,621 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,622 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:47,622 DEBUG [RS:1;jenkins-hbase4:34301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63ed78d7 to 127.0.0.1:56069 2023-02-19 20:00:47,622 INFO [RS:0;jenkins-hbase4:42491] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:47,622 DEBUG [RS:1;jenkins-hbase4:34301] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,623 INFO [RS:0;jenkins-hbase4:42491] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:47,623 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(3304): Received CLOSE for 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:47,623 INFO [RS:1;jenkins-hbase4:34301] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:47,623 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,623 INFO [RS:1;jenkins-hbase4:34301] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:47,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8cda856fdb288ed2892bd5f1f25246fe, disabling compactions & flushes 2023-02-19 20:00:47,623 INFO [RS:1;jenkins-hbase4:34301] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:47,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:47,623 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:47,623 DEBUG [RS:0;jenkins-hbase4:42491] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0344a73d to 127.0.0.1:56069 2023-02-19 20:00:47,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:47,623 DEBUG [RS:0;jenkins-hbase4:42491] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. after waiting 0 ms 2023-02-19 20:00:47,623 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 20:00:47,623 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 20:00:47,624 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 20:00:47,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:47,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:47,623 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1479): Online Regions={8cda856fdb288ed2892bd5f1f25246fe=hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe.} 2023-02-19 20:00:47,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:47,624 DEBUG [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1505): Waiting on 8cda856fdb288ed2892bd5f1f25246fe 2023-02-19 20:00:47,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:47,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8cda856fdb288ed2892bd5f1f25246fe 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:47,624 DEBUG [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 20:00:47,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:47,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:47,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-19 20:00:47,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/.tmp/info/4c6e4e7393a64e148391715f32e71981 2023-02-19 20:00:47,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/.tmp/info/58c8a87070a54ec8bc7fc3695dacb7ce 2023-02-19 20:00:47,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/.tmp/info/4c6e4e7393a64e148391715f32e71981 as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/info/4c6e4e7393a64e148391715f32e71981 2023-02-19 20:00:47,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58c8a87070a54ec8bc7fc3695dacb7ce 2023-02-19 20:00:47,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/info/4c6e4e7393a64e148391715f32e71981, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:47,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8cda856fdb288ed2892bd5f1f25246fe in 26ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:47,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/.tmp/rep_barrier/7b771513fde64ed3ae09282b541f2305 2023-02-19 20:00:47,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/namespace/8cda856fdb288ed2892bd5f1f25246fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:47,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:47,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8cda856fdb288ed2892bd5f1f25246fe: 2023-02-19 20:00:47,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836845189.8cda856fdb288ed2892bd5f1f25246fe. 2023-02-19 20:00:47,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b771513fde64ed3ae09282b541f2305 2023-02-19 20:00:47,665 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/.tmp/table/d538631f8a934b409c19c742542144ce 2023-02-19 20:00:47,669 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d538631f8a934b409c19c742542144ce 2023-02-19 20:00:47,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/.tmp/info/58c8a87070a54ec8bc7fc3695dacb7ce as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/info/58c8a87070a54ec8bc7fc3695dacb7ce 2023-02-19 20:00:47,670 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:47,671 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:47,674 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58c8a87070a54ec8bc7fc3695dacb7ce 2023-02-19 20:00:47,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/info/58c8a87070a54ec8bc7fc3695dacb7ce, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 20:00:47,675 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/.tmp/rep_barrier/7b771513fde64ed3ae09282b541f2305 as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/rep_barrier/7b771513fde64ed3ae09282b541f2305 2023-02-19 20:00:47,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b771513fde64ed3ae09282b541f2305 2023-02-19 20:00:47,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/rep_barrier/7b771513fde64ed3ae09282b541f2305, entries=1, sequenceid=21, filesize=5.1 K 2023-02-19 20:00:47,679 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/.tmp/table/d538631f8a934b409c19c742542144ce as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/table/d538631f8a934b409c19c742542144ce 2023-02-19 20:00:47,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d538631f8a934b409c19c742542144ce 2023-02-19 20:00:47,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/table/d538631f8a934b409c19c742542144ce, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 20:00:47,684 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false 2023-02-19 20:00:47,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 20:00:47,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:47,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:47,690 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:47,690 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:47,824 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42491,1676836844550; all regions closed. 2023-02-19 20:00:47,824 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34301,1676836844572; all regions closed. 2023-02-19 20:00:47,828 DEBUG [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/oldWALs 2023-02-19 20:00:47,829 INFO [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34301%2C1676836844572.meta:.meta(num 1676836845140) 2023-02-19 20:00:47,829 DEBUG [RS:0;jenkins-hbase4:42491] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/oldWALs 2023-02-19 20:00:47,829 INFO [RS:0;jenkins-hbase4:42491] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42491%2C1676836844550:(num 1676836845530) 2023-02-19 20:00:47,829 DEBUG [RS:0;jenkins-hbase4:42491] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,829 INFO [RS:0;jenkins-hbase4:42491] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:47,829 INFO [RS:0;jenkins-hbase4:42491] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:47,829 INFO [RS:0;jenkins-hbase4:42491] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:47,829 INFO [RS:0;jenkins-hbase4:42491] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:47,829 INFO [RS:0;jenkins-hbase4:42491] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:47,829 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:47,831 INFO [RS:0;jenkins-hbase4:42491] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42491 2023-02-19 20:00:47,832 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,832 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:47,832 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:47,832 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42491,1676836844550 2023-02-19 20:00:47,832 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e2c5b68 rejected from java.util.concurrent.ThreadPoolExecutor@4a13c675[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:47,832 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:47,833 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42491,1676836844550] 2023-02-19 20:00:47,833 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42491,1676836844550; numProcessing=1 2023-02-19 20:00:47,834 DEBUG [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/oldWALs 2023-02-19 20:00:47,834 INFO [RS:1;jenkins-hbase4:34301] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34301%2C1676836844572:(num 1676836845903) 2023-02-19 20:00:47,834 DEBUG [RS:1;jenkins-hbase4:34301] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,834 INFO [RS:1;jenkins-hbase4:34301] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:47,834 INFO [RS:1;jenkins-hbase4:34301] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:47,834 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:47,835 INFO [RS:1;jenkins-hbase4:34301] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34301 2023-02-19 20:00:47,836 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42491,1676836844550 already deleted, retry=false 2023-02-19 20:00:47,836 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42491,1676836844550 expired; onlineServers=1 2023-02-19 20:00:47,841 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34301,1676836844572 2023-02-19 20:00:47,841 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:47,841 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43216c6d rejected from java.util.concurrent.ThreadPoolExecutor@471ee0d1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:47,842 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34301,1676836844572] 2023-02-19 20:00:47,842 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34301,1676836844572; numProcessing=2 2023-02-19 20:00:47,843 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34301,1676836844572 already deleted, retry=false 2023-02-19 20:00:47,843 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34301,1676836844572 expired; onlineServers=0 2023-02-19 20:00:47,843 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38051,1676836844511' ***** 2023-02-19 20:00:47,843 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:47,844 DEBUG [M:0;jenkins-hbase4:38051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c6f87d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:47,844 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38051,1676836844511 2023-02-19 20:00:47,844 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38051,1676836844511; all regions closed. 2023-02-19 20:00:47,845 DEBUG [M:0;jenkins-hbase4:38051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:47,845 DEBUG [M:0;jenkins-hbase4:38051] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:47,845 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:47,845 DEBUG [M:0;jenkins-hbase4:38051] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:47,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836844758] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836844758,5,FailOnTimeoutGroup] 2023-02-19 20:00:47,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836844752] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836844752,5,FailOnTimeoutGroup] 2023-02-19 20:00:47,845 INFO [M:0;jenkins-hbase4:38051] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:47,846 INFO [M:0;jenkins-hbase4:38051] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:47,847 INFO [M:0;jenkins-hbase4:38051] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:47,847 DEBUG [M:0;jenkins-hbase4:38051] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:47,847 INFO [M:0;jenkins-hbase4:38051] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:47,848 ERROR [M:0;jenkins-hbase4:38051] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 20:00:47,848 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:47,848 INFO [M:0;jenkins-hbase4:38051] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:47,848 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:47,848 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:47,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:47,848 DEBUG [M:0;jenkins-hbase4:38051] zookeeper.ZKUtil(398): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:47,848 WARN [M:0;jenkins-hbase4:38051] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:47,848 INFO [M:0;jenkins-hbase4:38051] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:47,849 INFO [M:0;jenkins-hbase4:38051] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:47,849 DEBUG [M:0;jenkins-hbase4:38051] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:47,849 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:47,849 DEBUG [M:0;jenkins-hbase4:38051] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:47,849 DEBUG [M:0;jenkins-hbase4:38051] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:47,849 DEBUG [M:0;jenkins-hbase4:38051] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:47,849 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.68 KB 2023-02-19 20:00:47,862 INFO [M:0;jenkins-hbase4:38051] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/725531558d6f4a57a00631b2982598bd 2023-02-19 20:00:47,866 DEBUG [M:0;jenkins-hbase4:38051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/725531558d6f4a57a00631b2982598bd as hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/725531558d6f4a57a00631b2982598bd 2023-02-19 20:00:47,870 INFO [M:0;jenkins-hbase4:38051] regionserver.HStore(1080): Added hdfs://localhost:36449/user/jenkins/test-data/ad59e93f-5afe-00a0-6085-622b2b3f8b83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/725531558d6f4a57a00631b2982598bd, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 20:00:47,870 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58043, heapSize ~67.66 KB/69288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-19 20:00:47,871 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:47,871 DEBUG [M:0;jenkins-hbase4:38051] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:47,873 INFO [M:0;jenkins-hbase4:38051] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:47,873 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:47,874 INFO [M:0;jenkins-hbase4:38051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38051 2023-02-19 20:00:47,877 DEBUG [M:0;jenkins-hbase4:38051] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38051,1676836844511 already deleted, retry=false 2023-02-19 20:00:48,116 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:48,116 INFO [M:0;jenkins-hbase4:38051] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38051,1676836844511; zookeeper connection closed. 2023-02-19 20:00:48,116 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@857ae8 rejected from java.util.concurrent.ThreadPoolExecutor@4bafe20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:48,117 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): master:38051-0x1006e2b9d910000, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:48,117 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bca85a1 rejected from java.util.concurrent.ThreadPoolExecutor@4bafe20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:48,216 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:48,216 INFO [RS:1;jenkins-hbase4:34301] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34301,1676836844572; zookeeper connection closed. 2023-02-19 20:00:48,216 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b5e5e37 rejected from java.util.concurrent.ThreadPoolExecutor@471ee0d1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:48,216 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:34301-0x1006e2b9d910002, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:48,216 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2eee6364] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2eee6364 2023-02-19 20:00:48,216 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fc61e6 rejected from java.util.concurrent.ThreadPoolExecutor@471ee0d1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:48,316 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:48,316 INFO [RS:0;jenkins-hbase4:42491] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42491,1676836844550; zookeeper connection closed. 2023-02-19 20:00:48,316 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@128f4631 rejected from java.util.concurrent.ThreadPoolExecutor@4a13c675[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:48,317 DEBUG [Listener at localhost/34879-EventThread] zookeeper.ZKWatcher(600): regionserver:42491-0x1006e2b9d910001, quorum=127.0.0.1:56069, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:48,317 ERROR [Listener at localhost/34879-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6aa0f1d2 rejected from java.util.concurrent.ThreadPoolExecutor@4a13c675[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:48,317 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64028b5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64028b5 2023-02-19 20:00:48,317 INFO [Listener at localhost/34879] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:48,317 WARN [Listener at localhost/34879] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:48,321 INFO [Listener at localhost/34879] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:48,422 WARN [BP-2098337495-172.31.14.131-1676836843889 heartbeating to localhost/127.0.0.1:36449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:48,422 WARN [BP-2098337495-172.31.14.131-1676836843889 heartbeating to localhost/127.0.0.1:36449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2098337495-172.31.14.131-1676836843889 (Datanode Uuid 418a1661-5d98-4f71-9fe0-21d3d9deb7a5) service to localhost/127.0.0.1:36449 2023-02-19 20:00:48,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/dfs/data/data3/current/BP-2098337495-172.31.14.131-1676836843889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:48,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/dfs/data/data4/current/BP-2098337495-172.31.14.131-1676836843889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:48,425 WARN [Listener at localhost/34879] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:48,428 INFO [Listener at localhost/34879] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:48,529 WARN [BP-2098337495-172.31.14.131-1676836843889 heartbeating to localhost/127.0.0.1:36449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:48,529 WARN [BP-2098337495-172.31.14.131-1676836843889 heartbeating to localhost/127.0.0.1:36449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2098337495-172.31.14.131-1676836843889 (Datanode Uuid 59360058-b669-4040-838f-0edbb01903a4) service to localhost/127.0.0.1:36449 2023-02-19 20:00:48,529 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/dfs/data/data1/current/BP-2098337495-172.31.14.131-1676836843889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:48,530 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/cluster_05904c27-66a8-80fc-6bda-7bdeb04c07e5/dfs/data/data2/current/BP-2098337495-172.31.14.131-1676836843889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:48,540 INFO [Listener at localhost/34879] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:48,652 INFO [Listener at localhost/34879] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:48,672 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:48,684 INFO [Listener at localhost/34879] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=276 (was 257) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38051,1676836844511)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36449 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34879 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:36449 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36449 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36449 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36449 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:36449 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:36449 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=579 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=434 (was 473), ProcessCount=170 (was 170), AvailableMemoryMB=8876 (was 8948) 2023-02-19 20:00:48,694 INFO [Listener at localhost/34879] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=276, OpenFileDescriptor=579, MaxFileDescriptor=60000, SystemLoadAverage=434, ProcessCount=170, AvailableMemoryMB=8876 2023-02-19 20:00:48,704 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/hadoop.log.dir so I do NOT create it in target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420 2023-02-19 20:00:48,704 WARN [Listener at localhost/34879] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 20:00:48,704 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/hadoop.tmp.dir so I do NOT create it in target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420 2023-02-19 20:00:48,704 WARN [Listener at localhost/34879] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6c41bac1-2208-9646-169f-95e6452feb75/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 20:00:48,704 DEBUG [Listener at localhost/34879] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420 2023-02-19 20:00:48,704 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 20:00:48,704 INFO [Listener at localhost/34879] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb, deleteOnExit=true 2023-02-19 20:00:48,704 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/test.cache.data in system properties and HBase conf 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/hadoop.log.dir in system properties and HBase conf 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 20:00:48,705 DEBUG [Listener at localhost/34879] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 20:00:48,705 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/nfs.dump.dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/java.io.tmpdir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 20:00:48,706 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 20:00:48,707 INFO [Listener at localhost/34879] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 20:00:48,710 WARN [Listener at localhost/34879] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:48,711 WARN [Listener at localhost/34879] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:48,754 WARN [Listener at localhost/34879] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:48,755 INFO [Listener at localhost/34879] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:48,762 INFO [Listener at localhost/34879] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/java.io.tmpdir/Jetty_localhost_39137_hdfs____x00ic9/webapp 2023-02-19 20:00:48,870 INFO [Listener at localhost/34879] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39137 2023-02-19 20:00:48,875 WARN [Listener at localhost/34879] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 20:00:48,875 WARN [Listener at localhost/34879] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 20:00:48,943 WARN [Listener at localhost/39447] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:48,969 WARN [Listener at localhost/39447] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:48,972 WARN [Listener at localhost/39447] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:48,973 INFO [Listener at localhost/39447] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:48,979 INFO [Listener at localhost/39447] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/java.io.tmpdir/Jetty_localhost_45453_datanode____eafbbs/webapp 2023-02-19 20:00:49,076 INFO [Listener at localhost/39447] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45453 2023-02-19 20:00:49,084 WARN [Listener at localhost/37861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:49,100 WARN [Listener at localhost/37861] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 20:00:49,103 WARN [Listener at localhost/37861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 20:00:49,104 INFO [Listener at localhost/37861] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 20:00:49,108 INFO [Listener at localhost/37861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/java.io.tmpdir/Jetty_localhost_37823_datanode____ssvzss/webapp 2023-02-19 20:00:49,201 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5c869cfb768feec: Processing first storage report for DS-3a77e35d-1949-4544-94a8-0f8c280262c5 from datanode 7e7bcf54-85c9-4833-b31c-9d9fc5fda79d 2023-02-19 20:00:49,201 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5c869cfb768feec: from storage DS-3a77e35d-1949-4544-94a8-0f8c280262c5 node DatanodeRegistration(127.0.0.1:44283, datanodeUuid=7e7bcf54-85c9-4833-b31c-9d9fc5fda79d, infoPort=41211, infoSecurePort=0, ipcPort=37861, storageInfo=lv=-57;cid=testClusterID;nsid=262157873;c=1676836848713), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:49,201 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5c869cfb768feec: Processing first storage report for DS-b2281571-8847-4ae7-aafb-6420d4bae59d from datanode 7e7bcf54-85c9-4833-b31c-9d9fc5fda79d 2023-02-19 20:00:49,201 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5c869cfb768feec: from storage DS-b2281571-8847-4ae7-aafb-6420d4bae59d node DatanodeRegistration(127.0.0.1:44283, datanodeUuid=7e7bcf54-85c9-4833-b31c-9d9fc5fda79d, infoPort=41211, infoSecurePort=0, ipcPort=37861, storageInfo=lv=-57;cid=testClusterID;nsid=262157873;c=1676836848713), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:49,216 INFO [Listener at localhost/37861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37823 2023-02-19 20:00:49,241 WARN [Listener at localhost/36541] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 20:00:49,367 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ea09fdfa1db0758: Processing first storage report for DS-9697c377-88b1-49e7-8418-58ccaa8eb108 from datanode 86d4f3aa-bb16-49a8-903b-edfc28895e6b 2023-02-19 20:00:49,367 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ea09fdfa1db0758: from storage DS-9697c377-88b1-49e7-8418-58ccaa8eb108 node DatanodeRegistration(127.0.0.1:43365, datanodeUuid=86d4f3aa-bb16-49a8-903b-edfc28895e6b, infoPort=39401, infoSecurePort=0, ipcPort=36541, storageInfo=lv=-57;cid=testClusterID;nsid=262157873;c=1676836848713), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:49,367 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ea09fdfa1db0758: Processing first storage report for DS-0522b0fb-420e-4d2b-bcd7-cd887cc888ec from datanode 86d4f3aa-bb16-49a8-903b-edfc28895e6b 2023-02-19 20:00:49,367 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ea09fdfa1db0758: from storage DS-0522b0fb-420e-4d2b-bcd7-cd887cc888ec node DatanodeRegistration(127.0.0.1:43365, datanodeUuid=86d4f3aa-bb16-49a8-903b-edfc28895e6b, infoPort=39401, infoSecurePort=0, ipcPort=36541, storageInfo=lv=-57;cid=testClusterID;nsid=262157873;c=1676836848713), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 20:00:49,374 DEBUG [Listener at localhost/36541] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420 2023-02-19 20:00:49,381 INFO [Listener at localhost/36541] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/zookeeper_0, clientPort=54993, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 20:00:49,382 INFO [Listener at localhost/36541] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54993 2023-02-19 20:00:49,382 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,383 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,399 INFO [Listener at localhost/36541] util.FSUtils(479): Created version file at hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3 with version=8 2023-02-19 20:00:49,399 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,400 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,400 INFO [Listener at localhost/36541] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/hbase-staging 2023-02-19 20:00:49,402 INFO [Listener at localhost/36541] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:49,402 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,402 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,402 INFO [Listener at localhost/36541] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:49,402 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,402 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:49,403 INFO [Listener at localhost/36541] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:49,403 INFO [Listener at localhost/36541] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37323 2023-02-19 20:00:49,403 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,404 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,405 INFO [Listener at localhost/36541] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37323 connecting to ZooKeeper ensemble=127.0.0.1:54993 2023-02-19 20:00:49,412 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:373230x0, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:49,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37323-0x1006e2bb0a90000 connected 2023-02-19 20:00:49,428 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:49,429 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:49,429 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:49,430 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37323 2023-02-19 20:00:49,430 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37323 2023-02-19 20:00:49,437 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37323 2023-02-19 20:00:49,440 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37323 2023-02-19 20:00:49,440 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37323 2023-02-19 20:00:49,440 INFO [Listener at localhost/36541] master.HMaster(444): hbase.rootdir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3, hbase.cluster.distributed=false 2023-02-19 20:00:49,458 INFO [Listener at localhost/36541] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:49,458 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,458 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,458 INFO [Listener at localhost/36541] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:49,459 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,459 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:49,459 INFO [Listener at localhost/36541] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:49,460 INFO [Listener at localhost/36541] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35459 2023-02-19 20:00:49,460 INFO [Listener at localhost/36541] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:49,464 DEBUG [Listener at localhost/36541] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:49,464 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,465 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,466 INFO [Listener at localhost/36541] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35459 connecting to ZooKeeper ensemble=127.0.0.1:54993 2023-02-19 20:00:49,468 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:354590x0, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:49,469 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): regionserver:354590x0, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:49,469 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): regionserver:354590x0, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:49,469 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): regionserver:354590x0, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:49,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35459-0x1006e2bb0a90001 connected 2023-02-19 20:00:49,474 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35459 2023-02-19 20:00:49,476 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35459 2023-02-19 20:00:49,480 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35459 2023-02-19 20:00:49,480 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35459 2023-02-19 20:00:49,481 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35459 2023-02-19 20:00:49,493 INFO [Listener at localhost/36541] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 20:00:49,493 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,493 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,493 INFO [Listener at localhost/36541] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 20:00:49,493 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 20:00:49,494 INFO [Listener at localhost/36541] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 20:00:49,494 INFO [Listener at localhost/36541] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 20:00:49,494 INFO [Listener at localhost/36541] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44177 2023-02-19 20:00:49,494 INFO [Listener at localhost/36541] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 20:00:49,496 DEBUG [Listener at localhost/36541] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:49,496 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,497 INFO [Listener at localhost/36541] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,498 INFO [Listener at localhost/36541] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44177 connecting to ZooKeeper ensemble=127.0.0.1:54993 2023-02-19 20:00:49,500 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:441770x0, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 20:00:49,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44177-0x1006e2bb0a90002 connected 2023-02-19 20:00:49,501 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:49,502 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:49,502 DEBUG [Listener at localhost/36541] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 20:00:49,503 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44177 2023-02-19 20:00:49,503 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44177 2023-02-19 20:00:49,503 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44177 2023-02-19 20:00:49,504 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44177 2023-02-19 20:00:49,505 DEBUG [Listener at localhost/36541] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44177 2023-02-19 20:00:49,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,508 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:49,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,511 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:49,511 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:49,511 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:49,513 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:49,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37323,1676836849402 from backup master directory 2023-02-19 20:00:49,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 20:00:49,516 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,516 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:49,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,516 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 20:00:49,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/hbase.id with ID: 6e55a67b-dbb8-4b84-a1b2-a98281f693f9 2023-02-19 20:00:49,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 20:00:49,537 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1bea0352 to 127.0.0.1:54993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:49,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1de489ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:49,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:49,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 20:00:49,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:49,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store-tmp 2023-02-19 20:00:49,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:49,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:49,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:49,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:49,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:49,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:49,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:49,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:49,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/WALs/jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37323%2C1676836849402, suffix=, logDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/WALs/jenkins-hbase4.apache.org,37323,1676836849402, archiveDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/oldWALs, maxLogs=10 2023-02-19 20:00:49,575 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK] 2023-02-19 20:00:49,575 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK] 2023-02-19 20:00:49,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/WALs/jenkins-hbase4.apache.org,37323,1676836849402/jenkins-hbase4.apache.org%2C37323%2C1676836849402.1676836849562 2023-02-19 20:00:49,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK], DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK]] 2023-02-19 20:00:49,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:49,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:49,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:49,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:49,578 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:49,579 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 20:00:49,579 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 20:00:49,580 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:49,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:49,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:49,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 20:00:49,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:49,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71181212, jitterRate=0.060682713985443115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:49,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 20:00:49,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 20:00:49,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 20:00:49,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 20:00:49,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 20:00:49,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 20:00:49,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 20:00:49,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 20:00:49,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 20:00:49,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 20:00:49,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 20:00:49,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 20:00:49,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 20:00:49,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 20:00:49,603 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 20:00:49,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 20:00:49,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 20:00:49,606 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:49,606 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:49,606 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:49,606 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37323,1676836849402, sessionid=0x1006e2bb0a90000, setting cluster-up flag (Was=false) 2023-02-19 20:00:49,612 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 20:00:49,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,622 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 20:00:49,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:49,627 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.hbase-snapshot/.tmp 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:49,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676836879632 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 20:00:49,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,632 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:49,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 20:00:49,633 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 20:00:49,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 20:00:49,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 20:00:49,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 20:00:49,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 20:00:49,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836849634,5,FailOnTimeoutGroup] 2023-02-19 20:00:49,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836849634,5,FailOnTimeoutGroup] 2023-02-19 20:00:49,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 20:00:49,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,634 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:49,641 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:49,642 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:49,642 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3 2023-02-19 20:00:49,647 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:49,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:49,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/info 2023-02-19 20:00:49,649 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:49,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:49,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:49,650 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:49,650 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:49,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:49,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:49,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/table 2023-02-19 20:00:49,652 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:49,652 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:49,652 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740 2023-02-19 20:00:49,653 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740 2023-02-19 20:00:49,654 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:49,654 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:49,655 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:49,656 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69867069, jitterRate=0.041100457310676575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:49,656 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:49,656 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:49,656 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:49,656 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:49,656 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:49,656 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:49,656 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:49,656 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:49,657 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 20:00:49,657 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 20:00:49,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 20:00:49,657 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 20:00:49,658 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 20:00:49,708 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(952): ClusterId : 6e55a67b-dbb8-4b84-a1b2-a98281f693f9 2023-02-19 20:00:49,708 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(952): ClusterId : 6e55a67b-dbb8-4b84-a1b2-a98281f693f9 2023-02-19 20:00:49,708 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:49,708 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 20:00:49,711 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:49,711 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 20:00:49,711 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:49,711 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 20:00:49,712 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:49,712 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 20:00:49,714 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ReadOnlyZKClient(139): Connect 0x7501b847 to 127.0.0.1:54993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:49,714 DEBUG [RS:1;jenkins-hbase4:44177] zookeeper.ReadOnlyZKClient(139): Connect 0x6f5545f8 to 127.0.0.1:54993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:49,718 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc64897, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:49,718 DEBUG [RS:1;jenkins-hbase4:44177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6192a662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:49,718 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ff9d337, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:49,718 DEBUG [RS:1;jenkins-hbase4:44177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65ad2e88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:49,727 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35459 2023-02-19 20:00:49,727 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44177 2023-02-19 20:00:49,727 INFO [RS:0;jenkins-hbase4:35459] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:49,727 INFO [RS:1;jenkins-hbase4:44177] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 20:00:49,727 INFO [RS:1;jenkins-hbase4:44177] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:49,727 INFO [RS:0;jenkins-hbase4:35459] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 20:00:49,727 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:49,727 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 20:00:49,727 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37323,1676836849402 with isa=jenkins-hbase4.apache.org/172.31.14.131:35459, startcode=1676836849457 2023-02-19 20:00:49,727 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37323,1676836849402 with isa=jenkins-hbase4.apache.org/172.31.14.131:44177, startcode=1676836849493 2023-02-19 20:00:49,728 DEBUG [RS:0;jenkins-hbase4:35459] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:49,728 DEBUG [RS:1;jenkins-hbase4:44177] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 20:00:49,730 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60003, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:49,730 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39267, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 20:00:49,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37323] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,732 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3 2023-02-19 20:00:49,732 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39447 2023-02-19 20:00:49,732 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:49,732 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3 2023-02-19 20:00:49,732 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39447 2023-02-19 20:00:49,732 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 20:00:49,734 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:49,738 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ZKUtil(162): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,738 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35459,1676836849457] 2023-02-19 20:00:49,738 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44177,1676836849493] 2023-02-19 20:00:49,738 DEBUG [RS:1;jenkins-hbase4:44177] zookeeper.ZKUtil(162): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,738 WARN [RS:0;jenkins-hbase4:35459] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:49,738 WARN [RS:1;jenkins-hbase4:44177] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 20:00:49,738 INFO [RS:0;jenkins-hbase4:35459] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:49,738 INFO [RS:1;jenkins-hbase4:44177] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:49,738 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,738 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,745 DEBUG [RS:1;jenkins-hbase4:44177] zookeeper.ZKUtil(162): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,745 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ZKUtil(162): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,746 DEBUG [RS:1;jenkins-hbase4:44177] zookeeper.ZKUtil(162): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,746 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ZKUtil(162): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,746 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:49,746 DEBUG [RS:1;jenkins-hbase4:44177] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 20:00:49,746 INFO [RS:0;jenkins-hbase4:35459] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:49,746 INFO [RS:1;jenkins-hbase4:44177] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 20:00:49,747 INFO [RS:0;jenkins-hbase4:35459] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:49,748 INFO [RS:0;jenkins-hbase4:35459] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:49,748 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,748 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:49,751 INFO [RS:1;jenkins-hbase4:44177] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 20:00:49,751 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,751 INFO [RS:1;jenkins-hbase4:44177] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 20:00:49,752 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,752 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 20:00:49,756 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,756 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,756 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,757 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,757 DEBUG [RS:1;jenkins-hbase4:44177] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 20:00:49,758 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,758 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,758 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,768 INFO [RS:0;jenkins-hbase4:35459] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:49,768 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35459,1676836849457-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,813 DEBUG [jenkins-hbase4:37323] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 20:00:49,814 DEBUG [jenkins-hbase4:37323] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:49,819 INFO [RS:1;jenkins-hbase4:44177] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 20:00:49,820 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44177,1676836849493-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:49,820 DEBUG [jenkins-hbase4:37323] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:49,820 DEBUG [jenkins-hbase4:37323] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:49,820 DEBUG [jenkins-hbase4:37323] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:49,820 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35459,1676836849457, state=OPENING 2023-02-19 20:00:49,823 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 20:00:49,825 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:49,825 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:49,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35459,1676836849457}] 2023-02-19 20:00:49,830 INFO [RS:0;jenkins-hbase4:35459] regionserver.Replication(203): jenkins-hbase4.apache.org,35459,1676836849457 started 2023-02-19 20:00:49,830 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35459,1676836849457, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35459, sessionid=0x1006e2bb0a90001 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35459,1676836849457' 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35459,1676836849457' 2023-02-19 20:00:49,831 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:49,832 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:49,832 INFO [RS:1;jenkins-hbase4:44177] regionserver.Replication(203): jenkins-hbase4.apache.org,44177,1676836849493 started 2023-02-19 20:00:49,832 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44177,1676836849493, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44177, sessionid=0x1006e2bb0a90002 2023-02-19 20:00:49,832 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 20:00:49,832 DEBUG [RS:1;jenkins-hbase4:44177] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,832 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:49,832 DEBUG [RS:1;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44177,1676836849493' 2023-02-19 20:00:49,832 DEBUG [RS:1;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:49,832 INFO [RS:0;jenkins-hbase4:35459] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:49,832 INFO [RS:0;jenkins-hbase4:35459] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:49,832 DEBUG [RS:1;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:49,832 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 20:00:49,833 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 20:00:49,833 DEBUG [RS:1;jenkins-hbase4:44177] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:49,833 DEBUG [RS:1;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44177,1676836849493' 2023-02-19 20:00:49,833 DEBUG [RS:1;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:49,833 DEBUG [RS:1;jenkins-hbase4:44177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:49,833 DEBUG [RS:1;jenkins-hbase4:44177] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 20:00:49,833 INFO [RS:1;jenkins-hbase4:44177] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 20:00:49,833 INFO [RS:1;jenkins-hbase4:44177] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 20:00:49,980 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:49,980 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 20:00:49,982 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 20:00:49,995 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 20:00:49,995 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 20:00:49,997 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35459%2C1676836849457.meta, suffix=.meta, logDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,35459,1676836849457, archiveDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/oldWALs, maxLogs=32 2023-02-19 20:00:50,018 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK] 2023-02-19 20:00:50,018 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK] 2023-02-19 20:00:50,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,35459,1676836849457/jenkins-hbase4.apache.org%2C35459%2C1676836849457.meta.1676836849997.meta 2023-02-19 20:00:50,024 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK], DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK]] 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 20:00:50,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 20:00:50,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 20:00:50,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 20:00:50,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/info 2023-02-19 20:00:50,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/info 2023-02-19 20:00:50,032 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 20:00:50,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:50,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 20:00:50,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:50,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/rep_barrier 2023-02-19 20:00:50,034 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 20:00:50,034 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:50,034 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 20:00:50,035 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/table 2023-02-19 20:00:50,035 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/table 2023-02-19 20:00:50,035 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 20:00:50,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:50,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740 2023-02-19 20:00:50,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740 2023-02-19 20:00:50,039 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 20:00:50,040 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 20:00:50,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66226368, jitterRate=-0.013150215148925781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 20:00:50,041 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 20:00:50,042 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676836849980 2023-02-19 20:00:50,046 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 20:00:50,048 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 20:00:50,048 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35459,1676836849457, state=OPEN 2023-02-19 20:00:50,049 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 20:00:50,050 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 20:00:50,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 20:00:50,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35459,1676836849457 in 225 msec 2023-02-19 20:00:50,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 20:00:50,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 394 msec 2023-02-19 20:00:50,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 425 msec 2023-02-19 20:00:50,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676836850054, completionTime=-1 2023-02-19 20:00:50,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 20:00:50,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 20:00:50,059 DEBUG [hconnection-0x1aa22f95-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:50,060 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:50,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 20:00:50,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676836910061 2023-02-19 20:00:50,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676836970061 2023-02-19 20:00:50,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-19 20:00:50,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37323,1676836849402-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37323,1676836849402-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37323,1676836849402-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37323, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 20:00:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 20:00:50,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:50,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 20:00:50,073 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 20:00:50,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:50,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:50,075 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,075 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a empty. 2023-02-19 20:00:50,076 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,076 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 20:00:50,091 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:50,092 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => adb93a852f9bad37fe816cb2dea9ca4a, NAME => 'hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp 2023-02-19 20:00:50,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:50,102 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing adb93a852f9bad37fe816cb2dea9ca4a, disabling compactions & flushes 2023-02-19 20:00:50,102 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,103 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,103 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. after waiting 0 ms 2023-02-19 20:00:50,103 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,103 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,103 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for adb93a852f9bad37fe816cb2dea9ca4a: 2023-02-19 20:00:50,105 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:50,106 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836850105"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836850105"}]},"ts":"1676836850105"} 2023-02-19 20:00:50,107 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:50,107 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:50,108 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836850108"}]},"ts":"1676836850108"} 2023-02-19 20:00:50,109 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 20:00:50,112 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:50,113 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:50,113 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:50,113 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:50,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=adb93a852f9bad37fe816cb2dea9ca4a, ASSIGN}] 2023-02-19 20:00:50,116 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=adb93a852f9bad37fe816cb2dea9ca4a, ASSIGN 2023-02-19 20:00:50,117 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=adb93a852f9bad37fe816cb2dea9ca4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35459,1676836849457; forceNewPlan=false, retain=false 2023-02-19 20:00:50,268 INFO [jenkins-hbase4:37323] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:50,268 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=adb93a852f9bad37fe816cb2dea9ca4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:50,268 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836850268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836850268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836850268"}]},"ts":"1676836850268"} 2023-02-19 20:00:50,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure adb93a852f9bad37fe816cb2dea9ca4a, server=jenkins-hbase4.apache.org,35459,1676836849457}] 2023-02-19 20:00:50,424 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,426 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35459%2C1676836849457, suffix=, logDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,35459,1676836849457, archiveDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/oldWALs, maxLogs=32 2023-02-19 20:00:50,440 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK] 2023-02-19 20:00:50,440 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK] 2023-02-19 20:00:50,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,35459,1676836849457/jenkins-hbase4.apache.org%2C35459%2C1676836849457.1676836850426 2023-02-19 20:00:50,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK], DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK]] 2023-02-19 20:00:50,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => adb93a852f9bad37fe816cb2dea9ca4a, NAME => 'hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:50,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:50,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,443 INFO [StoreOpener-adb93a852f9bad37fe816cb2dea9ca4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,444 DEBUG [StoreOpener-adb93a852f9bad37fe816cb2dea9ca4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/info 2023-02-19 20:00:50,444 DEBUG [StoreOpener-adb93a852f9bad37fe816cb2dea9ca4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/info 2023-02-19 20:00:50,445 INFO [StoreOpener-adb93a852f9bad37fe816cb2dea9ca4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adb93a852f9bad37fe816cb2dea9ca4a columnFamilyName info 2023-02-19 20:00:50,445 INFO [StoreOpener-adb93a852f9bad37fe816cb2dea9ca4a-1] regionserver.HStore(310): Store=adb93a852f9bad37fe816cb2dea9ca4a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:50,446 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,446 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:50,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:50,449 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened adb93a852f9bad37fe816cb2dea9ca4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63862661, jitterRate=-0.04837219417095184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 20:00:50,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for adb93a852f9bad37fe816cb2dea9ca4a: 2023-02-19 20:00:50,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a., pid=6, masterSystemTime=1676836850421 2023-02-19 20:00:50,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,453 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:50,453 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=adb93a852f9bad37fe816cb2dea9ca4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:50,453 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676836850453"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836850453"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836850453"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836850453"}]},"ts":"1676836850453"} 2023-02-19 20:00:50,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 20:00:50,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure adb93a852f9bad37fe816cb2dea9ca4a, server=jenkins-hbase4.apache.org,35459,1676836849457 in 185 msec 2023-02-19 20:00:50,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 20:00:50,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=adb93a852f9bad37fe816cb2dea9ca4a, ASSIGN in 342 msec 2023-02-19 20:00:50,456 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:50,457 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836850457"}]},"ts":"1676836850457"} 2023-02-19 20:00:50,457 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 20:00:50,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:50,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-19 20:00:50,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 20:00:50,473 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:50,473 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:50,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 20:00:50,482 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:50,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-02-19 20:00:50,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 20:00:50,492 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 20:00:50,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 6 msec 2023-02-19 20:00:50,501 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 20:00:50,503 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 20:00:50,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.987sec 2023-02-19 20:00:50,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 20:00:50,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 20:00:50,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 20:00:50,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37323,1676836849402-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 20:00:50,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37323,1676836849402-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 20:00:50,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 20:00:50,517 DEBUG [Listener at localhost/36541] zookeeper.ReadOnlyZKClient(139): Connect 0x26e193fa to 127.0.0.1:54993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:50,520 DEBUG [Listener at localhost/36541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63a36c42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:50,521 DEBUG [hconnection-0x241da286-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:50,523 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:50,524 INFO [Listener at localhost/36541] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:50,524 DEBUG [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 20:00:50,526 DEBUG [Listener at localhost/36541] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 20:00:50,527 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 20:00:50,528 INFO [Listener at localhost/36541] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 20:00:50,528 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 20:00:50,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 20:00:50,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:40506 deadline: 1676836910528, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 20:00:50,529 INFO [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 20:00:50,531 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 20:00:50,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 20:00:50,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 20:00:50,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 20:00:50,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 20:00:50,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:50,535 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,535 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f empty. 2023-02-19 20:00:50,535 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,535 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 20:00:50,544 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 20:00:50,545 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5853b19900548529d2e6677c6181a08f, NAME => 'testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp 2023-02-19 20:00:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5853b19900548529d2e6677c6181a08f, disabling compactions & flushes 2023-02-19 20:00:50,553 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. after waiting 0 ms 2023-02-19 20:00:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,553 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:50,555 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 20:00:50,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676836850556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836850556"}]},"ts":"1676836850556"} 2023-02-19 20:00:50,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 20:00:50,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 20:00:50,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836850558"}]},"ts":"1676836850558"} 2023-02-19 20:00:50,559 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 20:00:50,561 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 20:00:50,562 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 20:00:50,562 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 20:00:50,562 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 20:00:50,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, ASSIGN}] 2023-02-19 20:00:50,563 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, ASSIGN 2023-02-19 20:00:50,563 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35459,1676836849457; forceNewPlan=false, retain=false 2023-02-19 20:00:50,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:50,714 INFO [jenkins-hbase4:37323] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 20:00:50,714 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5853b19900548529d2e6677c6181a08f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:50,714 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676836850714"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836850714"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836850714"}]},"ts":"1676836850714"} 2023-02-19 20:00:50,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 5853b19900548529d2e6677c6181a08f, server=jenkins-hbase4.apache.org,35459,1676836849457}] 2023-02-19 20:00:50,835 INFO [RS:1;jenkins-hbase4:44177] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44177%2C1676836849493, suffix=, logDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,44177,1676836849493, archiveDir=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/oldWALs, maxLogs=32 2023-02-19 20:00:50,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:50,855 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK] 2023-02-19 20:00:50,855 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK] 2023-02-19 20:00:50,857 INFO [RS:1;jenkins-hbase4:44177] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,44177,1676836849493/jenkins-hbase4.apache.org%2C44177%2C1676836849493.1676836850835 2023-02-19 20:00:50,860 DEBUG [RS:1;jenkins-hbase4:44177] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44283,DS-3a77e35d-1949-4544-94a8-0f8c280262c5,DISK], DatanodeInfoWithStorage[127.0.0.1:43365,DS-9697c377-88b1-49e7-8418-58ccaa8eb108,DISK]] 2023-02-19 20:00:50,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5853b19900548529d2e6677c6181a08f, NAME => 'testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.', STARTKEY => '', ENDKEY => ''} 2023-02-19 20:00:50,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:50,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,871 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,872 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1 2023-02-19 20:00:50,872 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1 2023-02-19 20:00:50,872 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5853b19900548529d2e6677c6181a08f columnFamilyName f1 2023-02-19 20:00:50,872 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(310): Store=5853b19900548529d2e6677c6181a08f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:50,872 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,873 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2 2023-02-19 20:00:50,873 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2 2023-02-19 20:00:50,873 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5853b19900548529d2e6677c6181a08f columnFamilyName f2 2023-02-19 20:00:50,874 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(310): Store=5853b19900548529d2e6677c6181a08f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:50,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:50,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:50,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 20:00:50,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5853b19900548529d2e6677c6181a08f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69396962, jitterRate=0.034095317125320435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:50,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:50,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f., pid=12, masterSystemTime=1676836850867 2023-02-19 20:00:50,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:50,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5853b19900548529d2e6677c6181a08f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:50,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676836850880"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676836850880"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676836850880"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676836850880"}]},"ts":"1676836850880"} 2023-02-19 20:00:50,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 20:00:50,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 5853b19900548529d2e6677c6181a08f, server=jenkins-hbase4.apache.org,35459,1676836849457 in 167 msec 2023-02-19 20:00:50,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 20:00:50,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, ASSIGN in 321 msec 2023-02-19 20:00:50,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 20:00:50,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836850885"}]},"ts":"1676836850885"} 2023-02-19 20:00:50,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 20:00:50,887 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 20:00:50,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 356 msec 2023-02-19 20:00:51,048 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 20:00:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 20:00:51,137 INFO [Listener at localhost/36541] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 20:00:51,138 DEBUG [Listener at localhost/36541] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 20:00:51,138 INFO [Listener at localhost/36541] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:51,140 INFO [Listener at localhost/36541] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 20:00:51,140 INFO [Listener at localhost/36541] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 20:00:51,140 INFO [Listener at localhost/36541] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 20:00:51,140 INFO [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 20:00:51,173 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35459] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:51,269 INFO [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 20:00:51,269 INFO [Listener at localhost/36541] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 20:00:51,270 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:51,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676836851270 (current time:1676836851270). 2023-02-19 20:00:51,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 20:00:51,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] zookeeper.ReadOnlyZKClient(139): Connect 0x1f9b3b24 to 127.0.0.1:54993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 20:00:51,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c5739c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 20:00:51,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 20:00:51,277 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57248, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 20:00:51,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f9b3b24 to 127.0.0.1:54993 2023-02-19 20:00:51,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:51,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 20:00:51,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:51,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:51,281 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:51,282 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676837451282 2023-02-19 20:00:51,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 20:00:51,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 20:00:51,284 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:51,284 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 20:00:51,284 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 20:00:51,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:51,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-19 20:00:51,285 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:51,286 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676837451286 2023-02-19 20:00:51,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-19 20:00:51,293 INFO [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-19 20:00:51,293 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:51,294 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-19 20:00:51,294 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 20:00:51,294 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,294 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,296 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:51,296 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:51,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:51,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:51,296 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,296 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,296 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-19 20:00:51,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-19 20:00:51,297 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-19 20:00:51,297 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:51,298 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 20:00:51,298 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-19 20:00:51,298 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 20:00:51,298 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-19 20:00:51,298 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35459,1676836849457' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-19 20:00:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 20:00:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-19 20:00:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44177,1676836849493' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-19 20:00:51,302 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 20:00:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:51,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35459,1676836849457' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-19 20:00:51,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@326e0af3[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:51,306 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 20:00:51,307 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,309 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 20:00:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-19 20:00:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 20:00:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44177,1676836849493' in zk 2023-02-19 20:00:51,310 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,310 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 20:00:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 20:00:51,310 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:51,310 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. started... 2023-02-19 20:00:51,310 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5853b19900548529d2e6677c6181a08f 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 20:00:51,311 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-19 20:00:51,311 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:51,311 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-19 20:00:51,384 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:51,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:51,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:51,385 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 20:00:51,586 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 20:00:51,587 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 20:00:51,727 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f1/391c505ae76a4b7e9baa9b737eb53f57 2023-02-19 20:00:51,745 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f2/d1b56651a9234bab9ffd9b8276714d7f 2023-02-19 20:00:51,749 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f1/391c505ae76a4b7e9baa9b737eb53f57 as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/391c505ae76a4b7e9baa9b737eb53f57 2023-02-19 20:00:51,753 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/391c505ae76a4b7e9baa9b737eb53f57, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:51,754 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f2/d1b56651a9234bab9ffd9b8276714d7f as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/d1b56651a9234bab9ffd9b8276714d7f 2023-02-19 20:00:51,758 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/d1b56651a9234bab9ffd9b8276714d7f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 20:00:51,759 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 5853b19900548529d2e6677c6181a08f in 449ms, sequenceid=5, compaction requested=false 2023-02-19 20:00:51,759 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/391c505ae76a4b7e9baa9b737eb53f57] hfiles 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/391c505ae76a4b7e9baa9b737eb53f57 for snapshot=testWithMapReduceSingleRegion 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/d1b56651a9234bab9ffd9b8276714d7f] hfiles 2023-02-19 20:00:51,760 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/d1b56651a9234bab9ffd9b8276714d7f for snapshot=testWithMapReduceSingleRegion 2023-02-19 20:00:51,778 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. completed. 2023-02-19 20:00:51,778 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 20:00:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 20:00:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-19 20:00:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35459,1676836849457' in zk 2023-02-19 20:00:51,779 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-19 20:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-19 20:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 20:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 20:00:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,35459,1676836849457': 2023-02-19 20:00:51,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35459,1676836849457' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 20:00:51,784 INFO [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-19 20:00:51,784 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:51,784 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:51,784 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-19 20:00:51,784 INFO [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 20:00:51,786 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 20:00:51,786 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:51,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:51,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:51,786 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,787 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 20:00:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:51,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 20:00:51,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,788 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:51,789 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 20:00:51,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 20:00:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:51,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 20:00:51,796 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-19 20:00:51,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-19 20:00:51,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 20:00:51,796 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 20:00:51,797 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:51,797 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,797 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:51,797 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 20:00:51,797 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 20:00:51,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 20:00:51,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 20:00:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 20:00:51,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-19 20:00:51,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-19 20:00:51,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 20:00:51,826 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 20:00:51,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676836851282Consolidate snapshot: testWithMapReduceSingleRegion at 1676836851796 (+514 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676836851796Writing data manifest for testWithMapReduceSingleRegion at 1676836851799 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676836851806 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676836851826 (+20 ms) 2023-02-19 20:00:51,830 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 20:00:51,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 546 msec 2023-02-19 20:00:51,887 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 20:00:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 20:00:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 20:00:51,888 INFO [Listener at localhost/36541] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 20:00:51,891 INFO [Listener at localhost/36541] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 20:00:51,895 INFO [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 20:00:51,923 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35459] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,012 INFO [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 20:00:52,017 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 20:00:52,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 20:00:52,018 INFO [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 20:00:52,018 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:52,018 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 20:00:52,018 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 20:00:52,019 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,019 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,020 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,020 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:52,020 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:52,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:52,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:52,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:52,020 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,021 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 20:00:52,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 20:00:52,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 20:00:52,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44177,1676836849493' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 20:00:52,022 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 20:00:52,022 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,022 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. started... 2023-02-19 20:00:52,022 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5853b19900548529d2e6677c6181a08f 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 20:00:52,023 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,023 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,023 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:52,036 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f1/1e3553e98d464392b26f3b6d3893c562 2023-02-19 20:00:52,054 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f2/1d0bd226afd4402bb786af66b72e1b11 2023-02-19 20:00:52,058 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f1/1e3553e98d464392b26f3b6d3893c562 as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/1e3553e98d464392b26f3b6d3893c562 2023-02-19 20:00:52,062 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/1e3553e98d464392b26f3b6d3893c562, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:52,062 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/.tmp/f2/1d0bd226afd4402bb786af66b72e1b11 as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/1d0bd226afd4402bb786af66b72e1b11 2023-02-19 20:00:52,066 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/1d0bd226afd4402bb786af66b72e1b11, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 20:00:52,066 INFO [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 5853b19900548529d2e6677c6181a08f in 44ms, sequenceid=9, compaction requested=false 2023-02-19 20:00:52,068 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:52,068 DEBUG [rs(jenkins-hbase4.apache.org,35459,1676836849457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 20:00:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 20:00:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 20:00:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35459,1676836849457' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 20:00:52,070 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,070 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:52,070 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:52,070 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 20:00:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:52,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35459,1676836849457' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 20:00:52,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36518866[Count = 0] remaining members to acquire global barrier 2023-02-19 20:00:52,072 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 20:00:52,072 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 20:00:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 20:00:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 20:00:52,073 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,073 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 20:00:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44177,1676836849493' in zk 2023-02-19 20:00:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 20:00:52,074 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35459,1676836849457' in zk 2023-02-19 20:00:52,075 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 20:00:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 20:00:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,44177,1676836849493' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 20:00:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1676836849457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 20:00:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35459,1676836849457': 2023-02-19 20:00:52,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35459,1676836849457' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 20:00:52,077 INFO [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 20:00:52,077 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 20:00:52,077 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 20:00:52,077 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 20:00:52,077 INFO [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 20:00:52,079 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:52,079 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 20:00:52,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:52,079 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:52,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 20:00:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:52,079 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 20:00:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,081 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,081 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 20:00:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 20:00:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,085 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:52,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:52,085 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:52,085 DEBUG [(jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 20:00:52,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-19 20:00:52,085 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 20:00:52,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 20:00:52,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 20:00:52,085 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 20:00:52,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 20:00:52,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 20:00:52,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:52,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 20:00:52,086 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 20:00:52,186 DEBUG [Listener at localhost/36541] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 20:00:52,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 20:00:52,276 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/hadoop-3313473407749012956.jar 2023-02-19 20:00:52,279 INFO [Listener at localhost/36541] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676836851270 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:52,279 DEBUG [Listener at localhost/36541] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137/data/default/testWithMapReduce 2023-02-19 20:00:52,279 INFO [Listener at localhost/36541] snapshot.RestoreSnapshotHelper(239): region to add: 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:52,279 INFO [Listener at localhost/36541] snapshot.RestoreSnapshotHelper(585): clone region=5853b19900548529d2e6677c6181a08f as 5853b19900548529d2e6677c6181a08f in snapshot testWithMapReduceSingleRegion 2023-02-19 20:00:52,280 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5853b19900548529d2e6677c6181a08f, NAME => 'testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137 2023-02-19 20:00:52,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:52,286 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 391c505ae76a4b7e9baa9b737eb53f57 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-19 20:00:52,288 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d1b56651a9234bab9ffd9b8276714d7f from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-19 20:00:52,290 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5853b19900548529d2e6677c6181a08f, disabling compactions & flushes 2023-02-19 20:00:52,291 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,291 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,291 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. after waiting 0 ms 2023-02-19 20:00:52,291 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,291 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,291 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:52,291 INFO [Listener at localhost/36541] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676836851270 type: FLUSH version: 2 ttl: 0 2023-02-19 20:00:52,291 DEBUG [Listener at localhost/36541] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137 2023-02-19 20:00:52,291 DEBUG [Listener at localhost/36541] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137 2023-02-19 20:00:52,292 DEBUG [Listener at localhost/36541] util.CommonFSUtils(699): |-data/ 2023-02-19 20:00:52,292 DEBUG [Listener at localhost/36541] util.CommonFSUtils(699): |----default/ 2023-02-19 20:00:52,292 DEBUG [Listener at localhost/36541] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 20:00:52,292 DEBUG [Listener at localhost/36541] util.CommonFSUtils(699): |----------5853b19900548529d2e6677c6181a08f/ 2023-02-19 20:00:52,293 DEBUG [Listener at localhost/36541] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 20:00:52,293 DEBUG [Listener at localhost/36541] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 20:00:52,293 DEBUG [Listener at localhost/36541] util.CommonFSUtils(702): |----------------testWithMapReduce=5853b19900548529d2e6677c6181a08f-391c505ae76a4b7e9baa9b737eb53f57 2023-02-19 20:00:52,293 DEBUG [Listener at localhost/36541] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 20:00:52,294 DEBUG [Listener at localhost/36541] util.CommonFSUtils(702): |----------------testWithMapReduce=5853b19900548529d2e6677c6181a08f-d1b56651a9234bab9ffd9b8276714d7f 2023-02-19 20:00:52,294 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,294 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,295 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,295 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,296 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,296 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,296 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,374 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/hadoop-5950088983690132911.jar 2023-02-19 20:00:52,374 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,375 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,375 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,375 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,375 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,376 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,376 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 20:00:52,376 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 20:00:52,377 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 20:00:52,377 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 20:00:52,377 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 20:00:52,378 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 20:00:52,378 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 20:00:52,378 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 20:00:52,379 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 20:00:52,379 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 20:00:52,380 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 20:00:52,380 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:52,380 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:52,380 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 20:00:52,381 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 20:00:52,450 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/hadoop-7452778908118124064.jar 2023-02-19 20:00:52,451 DEBUG [Listener at localhost/36541] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 20:00:52,456 WARN [Listener at localhost/36541] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 20:00:52,488 INFO [Listener at localhost/36541] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 20:00:52,597 WARN [Listener at localhost/36541] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/mapreduce.cluster.local.dir/1676836852532/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 20:00:52,597 WARN [Listener at localhost/36541] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/mapreduce.cluster.local.dir/1676836852532/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 20:00:52,637 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 20:00:52,637 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 20:00:52,637 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 20:00:52,639 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:52,640 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1 2023-02-19 20:00:52,640 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5853b19900548529d2e6677c6181a08f columnFamilyName f1 2023-02-19 20:00:52,644 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(539): loaded hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/testWithMapReduce=5853b19900548529d2e6677c6181a08f-391c505ae76a4b7e9baa9b737eb53f57 2023-02-19 20:00:52,644 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(310): Store=5853b19900548529d2e6677c6181a08f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:52,644 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:52,645 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2 2023-02-19 20:00:52,645 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5853b19900548529d2e6677c6181a08f columnFamilyName f2 2023-02-19 20:00:52,648 DEBUG [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(539): loaded hdfs://localhost:39447/user/jenkins/test-data/4ba550fe-13a7-e72d-23c8-7f6afcc8437c/testWithMapReduceSingleRegion/023bef0b-887b-4292-b84b-dfd214932137/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/testWithMapReduce=5853b19900548529d2e6677c6181a08f-d1b56651a9234bab9ffd9b8276714d7f 2023-02-19 20:00:52,648 INFO [StoreOpener-5853b19900548529d2e6677c6181a08f-1] regionserver.HStore(310): Store=5853b19900548529d2e6677c6181a08f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 20:00:52,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 20:00:52,649 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5853b19900548529d2e6677c6181a08f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69614844, jitterRate=0.03734201192855835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 20:00:52,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:52,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5853b19900548529d2e6677c6181a08f, disabling compactions & flushes 2023-02-19 20:00:52,763 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. after waiting 0 ms 2023-02-19 20:00:52,763 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,764 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:52,765 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:53,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-19 20:00:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-19 20:00:53,644 INFO [Listener at localhost/36541] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 20:00:53,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 20:00:53,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,648 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836853647"}]},"ts":"1676836853647"} 2023-02-19 20:00:53,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:53,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-19 20:00:53,650 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-19 20:00:53,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, UNASSIGN}] 2023-02-19 20:00:53,652 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, UNASSIGN 2023-02-19 20:00:53,653 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5853b19900548529d2e6677c6181a08f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:53,653 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676836853653"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676836853653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676836853653"}]},"ts":"1676836853653"} 2023-02-19 20:00:53,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 5853b19900548529d2e6677c6181a08f, server=jenkins-hbase4.apache.org,35459,1676836849457}] 2023-02-19 20:00:53,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:53,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:53,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5853b19900548529d2e6677c6181a08f, disabling compactions & flushes 2023-02-19 20:00:53,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:53,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:53,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. after waiting 0 ms 2023-02-19 20:00:53,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:53,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 20:00:53,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f. 2023-02-19 20:00:53,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5853b19900548529d2e6677c6181a08f: 2023-02-19 20:00:53,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:53,815 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5853b19900548529d2e6677c6181a08f, regionState=CLOSED 2023-02-19 20:00:53,815 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676836853815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676836853815"}]},"ts":"1676836853815"} 2023-02-19 20:00:53,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 20:00:53,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 5853b19900548529d2e6677c6181a08f, server=jenkins-hbase4.apache.org,35459,1676836849457 in 162 msec 2023-02-19 20:00:53,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 20:00:53,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5853b19900548529d2e6677c6181a08f, UNASSIGN in 166 msec 2023-02-19 20:00:53,819 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676836853819"}]},"ts":"1676836853819"} 2023-02-19 20:00:53,820 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-19 20:00:53,821 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-19 20:00:53,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 176 msec 2023-02-19 20:00:53,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 20:00:53,950 INFO [Listener at localhost/36541] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-19 20:00:53,951 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-19 20:00:53,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,953 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:53,956 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:53,958 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1, FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2, FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/recovered.edits] 2023-02-19 20:00:53,961 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/1e3553e98d464392b26f3b6d3893c562 to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/archive/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/1e3553e98d464392b26f3b6d3893c562 2023-02-19 20:00:53,962 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/391c505ae76a4b7e9baa9b737eb53f57 to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/archive/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f1/391c505ae76a4b7e9baa9b737eb53f57 2023-02-19 20:00:53,965 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/1d0bd226afd4402bb786af66b72e1b11 to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/archive/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/1d0bd226afd4402bb786af66b72e1b11 2023-02-19 20:00:53,966 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/d1b56651a9234bab9ffd9b8276714d7f to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/archive/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/f2/d1b56651a9234bab9ffd9b8276714d7f 2023-02-19 20:00:53,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/recovered.edits/12.seqid to hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/archive/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f/recovered.edits/12.seqid 2023-02-19 20:00:53,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/.tmp/data/default/testWithMapReduce/5853b19900548529d2e6677c6181a08f 2023-02-19 20:00:53,968 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 20:00:53,970 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,971 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-19 20:00:53,973 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-19 20:00:53,974 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,974 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-19 20:00:53,974 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676836853974"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:53,975 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 20:00:53,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5853b19900548529d2e6677c6181a08f, NAME => 'testWithMapReduce,,1676836850531.5853b19900548529d2e6677c6181a08f.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 20:00:53,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-19 20:00:53,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676836853975"}]},"ts":"9223372036854775807"} 2023-02-19 20:00:53,976 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-19 20:00:53,979 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 20:00:53,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 28 msec 2023-02-19 20:00:54,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37323] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 20:00:54,055 INFO [Listener at localhost/36541] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-19 20:00:54,055 INFO [Listener at localhost/36541] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 20:00:54,056 INFO [Listener at localhost/36541] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 20:00:54,056 DEBUG [Listener at localhost/36541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26e193fa to 127.0.0.1:54993 2023-02-19 20:00:54,056 DEBUG [Listener at localhost/36541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,056 DEBUG [Listener at localhost/36541] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 20:00:54,056 DEBUG [Listener at localhost/36541] util.JVMClusterUtil(257): Found active master hash=267129201, stopped=false 2023-02-19 20:00:54,056 INFO [Listener at localhost/36541] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:54,058 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:54,058 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:54,058 INFO [Listener at localhost/36541] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 20:00:54,058 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 20:00:54,058 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:54,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:54,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:54,060 DEBUG [Listener at localhost/36541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bea0352 to 127.0.0.1:54993 2023-02-19 20:00:54,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 20:00:54,060 DEBUG [Listener at localhost/36541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,060 INFO [Listener at localhost/36541] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35459,1676836849457' ***** 2023-02-19 20:00:54,060 INFO [Listener at localhost/36541] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:54,060 INFO [Listener at localhost/36541] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44177,1676836849493' ***** 2023-02-19 20:00:54,060 INFO [Listener at localhost/36541] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 20:00:54,060 INFO [RS:0;jenkins-hbase4:35459] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:54,060 INFO [RS:1;jenkins-hbase4:44177] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 20:00:54,060 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:54,060 INFO [RS:0;jenkins-hbase4:35459] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:54,061 INFO [RS:1;jenkins-hbase4:44177] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 20:00:54,062 INFO [RS:0;jenkins-hbase4:35459] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:54,061 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 20:00:54,062 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(3304): Received CLOSE for adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:54,062 INFO [RS:1;jenkins-hbase4:44177] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 20:00:54,063 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:54,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing adb93a852f9bad37fe816cb2dea9ca4a, disabling compactions & flushes 2023-02-19 20:00:54,063 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:54,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:54,063 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7501b847 to 127.0.0.1:54993 2023-02-19 20:00:54,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:54,063 DEBUG [RS:1;jenkins-hbase4:44177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f5545f8 to 127.0.0.1:54993 2023-02-19 20:00:54,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. after waiting 0 ms 2023-02-19 20:00:54,063 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:54,063 DEBUG [RS:1;jenkins-hbase4:44177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing adb93a852f9bad37fe816cb2dea9ca4a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 20:00:54,063 INFO [RS:0;jenkins-hbase4:35459] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:54,063 INFO [RS:0;jenkins-hbase4:35459] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:54,063 INFO [RS:0;jenkins-hbase4:35459] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:54,063 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44177,1676836849493; all regions closed. 2023-02-19 20:00:54,063 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 20:00:54,064 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 20:00:54,064 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1479): Online Regions={adb93a852f9bad37fe816cb2dea9ca4a=hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a., 1588230740=hbase:meta,,1.1588230740} 2023-02-19 20:00:54,064 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1505): Waiting on 1588230740, adb93a852f9bad37fe816cb2dea9ca4a 2023-02-19 20:00:54,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 20:00:54,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 20:00:54,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 20:00:54,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 20:00:54,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 20:00:54,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-19 20:00:54,070 DEBUG [RS:1;jenkins-hbase4:44177] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/oldWALs 2023-02-19 20:00:54,070 INFO [RS:1;jenkins-hbase4:44177] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44177%2C1676836849493:(num 1676836850835) 2023-02-19 20:00:54,070 DEBUG [RS:1;jenkins-hbase4:44177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,070 INFO [RS:1;jenkins-hbase4:44177] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:54,070 INFO [RS:1;jenkins-hbase4:44177] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:54,070 INFO [RS:1;jenkins-hbase4:44177] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 20:00:54,070 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:54,070 INFO [RS:1;jenkins-hbase4:44177] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 20:00:54,071 INFO [RS:1;jenkins-hbase4:44177] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 20:00:54,072 INFO [RS:1;jenkins-hbase4:44177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44177 2023-02-19 20:00:54,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:54,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:54,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44177,1676836849493 2023-02-19 20:00:54,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:54,073 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:54,073 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4df5b7a rejected from java.util.concurrent.ThreadPoolExecutor@e0df39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,074 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44177,1676836849493] 2023-02-19 20:00:54,074 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44177,1676836849493; numProcessing=1 2023-02-19 20:00:54,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/.tmp/info/f8ba68c13eaa4278a013d5790c12b236 2023-02-19 20:00:54,076 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/.tmp/info/5a4f20efd820408f944617169d80ca0d 2023-02-19 20:00:54,076 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44177,1676836849493 already deleted, retry=false 2023-02-19 20:00:54,076 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44177,1676836849493 expired; onlineServers=1 2023-02-19 20:00:54,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a4f20efd820408f944617169d80ca0d 2023-02-19 20:00:54,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/.tmp/info/f8ba68c13eaa4278a013d5790c12b236 as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/info/f8ba68c13eaa4278a013d5790c12b236 2023-02-19 20:00:54,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/info/f8ba68c13eaa4278a013d5790c12b236, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 20:00:54,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for adb93a852f9bad37fe816cb2dea9ca4a in 21ms, sequenceid=6, compaction requested=false 2023-02-19 20:00:54,087 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:54,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/.tmp/rep_barrier/aa65342dafdf48f08a75770f6a9ab679 2023-02-19 20:00:54,088 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:54,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/namespace/adb93a852f9bad37fe816cb2dea9ca4a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 20:00:54,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:54,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for adb93a852f9bad37fe816cb2dea9ca4a: 2023-02-19 20:00:54,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676836850071.adb93a852f9bad37fe816cb2dea9ca4a. 2023-02-19 20:00:54,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa65342dafdf48f08a75770f6a9ab679 2023-02-19 20:00:54,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/.tmp/table/8d073bd1057d40cd954ed67fd7ae180b 2023-02-19 20:00:54,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d073bd1057d40cd954ed67fd7ae180b 2023-02-19 20:00:54,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/.tmp/info/5a4f20efd820408f944617169d80ca0d as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/info/5a4f20efd820408f944617169d80ca0d 2023-02-19 20:00:54,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a4f20efd820408f944617169d80ca0d 2023-02-19 20:00:54,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/info/5a4f20efd820408f944617169d80ca0d, entries=12, sequenceid=21, filesize=6.2 K 2023-02-19 20:00:54,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/.tmp/rep_barrier/aa65342dafdf48f08a75770f6a9ab679 as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/rep_barrier/aa65342dafdf48f08a75770f6a9ab679 2023-02-19 20:00:54,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa65342dafdf48f08a75770f6a9ab679 2023-02-19 20:00:54,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/rep_barrier/aa65342dafdf48f08a75770f6a9ab679, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 20:00:54,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/.tmp/table/8d073bd1057d40cd954ed67fd7ae180b as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/table/8d073bd1057d40cd954ed67fd7ae180b 2023-02-19 20:00:54,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d073bd1057d40cd954ed67fd7ae180b 2023-02-19 20:00:54,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/table/8d073bd1057d40cd954ed67fd7ae180b, entries=4, sequenceid=21, filesize=5.0 K 2023-02-19 20:00:54,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false 2023-02-19 20:00:54,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 20:00:54,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 20:00:54,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:54,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 20:00:54,119 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 20:00:54,175 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:54,175 INFO [RS:1;jenkins-hbase4:44177] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44177,1676836849493; zookeeper connection closed. 2023-02-19 20:00:54,175 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a171f48 rejected from java.util.concurrent.ThreadPoolExecutor@e0df39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,175 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:44177-0x1006e2bb0a90002, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:54,175 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6da2fbf2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6da2fbf2 2023-02-19 20:00:54,175 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72f28148 rejected from java.util.concurrent.ThreadPoolExecutor@e0df39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,264 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35459,1676836849457; all regions closed. 2023-02-19 20:00:54,268 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/WALs/jenkins-hbase4.apache.org,35459,1676836849457/jenkins-hbase4.apache.org%2C35459%2C1676836849457.meta.1676836849997.meta not finished, retry = 0 2023-02-19 20:00:54,370 DEBUG [RS:0;jenkins-hbase4:35459] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/oldWALs 2023-02-19 20:00:54,370 INFO [RS:0;jenkins-hbase4:35459] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35459%2C1676836849457.meta:.meta(num 1676836849997) 2023-02-19 20:00:54,373 DEBUG [RS:0;jenkins-hbase4:35459] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/oldWALs 2023-02-19 20:00:54,373 INFO [RS:0;jenkins-hbase4:35459] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35459%2C1676836849457:(num 1676836850426) 2023-02-19 20:00:54,373 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,373 INFO [RS:0;jenkins-hbase4:35459] regionserver.LeaseManager(133): Closed leases 2023-02-19 20:00:54,373 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 20:00:54,374 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:54,376 INFO [RS:0;jenkins-hbase4:35459] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35459 2023-02-19 20:00:54,378 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35459,1676836849457 2023-02-19 20:00:54,378 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 20:00:54,378 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d02e431 rejected from java.util.concurrent.ThreadPoolExecutor@593d6b49[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,381 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35459,1676836849457] 2023-02-19 20:00:54,381 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35459,1676836849457; numProcessing=2 2023-02-19 20:00:54,382 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35459,1676836849457 already deleted, retry=false 2023-02-19 20:00:54,382 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35459,1676836849457 expired; onlineServers=0 2023-02-19 20:00:54,382 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37323,1676836849402' ***** 2023-02-19 20:00:54,382 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 20:00:54,383 DEBUG [M:0;jenkins-hbase4:37323] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd39454, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 20:00:54,383 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37323,1676836849402 2023-02-19 20:00:54,383 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37323,1676836849402; all regions closed. 2023-02-19 20:00:54,383 DEBUG [M:0;jenkins-hbase4:37323] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 20:00:54,383 DEBUG [M:0;jenkins-hbase4:37323] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 20:00:54,383 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 20:00:54,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836849634] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676836849634,5,FailOnTimeoutGroup] 2023-02-19 20:00:54,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836849634] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676836849634,5,FailOnTimeoutGroup] 2023-02-19 20:00:54,383 DEBUG [M:0;jenkins-hbase4:37323] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 20:00:54,385 INFO [M:0;jenkins-hbase4:37323] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 20:00:54,385 INFO [M:0;jenkins-hbase4:37323] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 20:00:54,385 INFO [M:0;jenkins-hbase4:37323] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 20:00:54,385 DEBUG [M:0;jenkins-hbase4:37323] master.HMaster(1512): Stopping service threads 2023-02-19 20:00:54,385 INFO [M:0;jenkins-hbase4:37323] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 20:00:54,386 ERROR [M:0;jenkins-hbase4:37323] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 20:00:54,386 INFO [M:0;jenkins-hbase4:37323] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 20:00:54,386 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 20:00:54,386 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 20:00:54,386 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 20:00:54,386 DEBUG [M:0;jenkins-hbase4:37323] zookeeper.ZKUtil(398): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 20:00:54,386 WARN [M:0;jenkins-hbase4:37323] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 20:00:54,386 INFO [M:0;jenkins-hbase4:37323] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 20:00:54,387 INFO [M:0;jenkins-hbase4:37323] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 20:00:54,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 20:00:54,387 DEBUG [M:0;jenkins-hbase4:37323] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 20:00:54,387 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:54,387 DEBUG [M:0;jenkins-hbase4:37323] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:54,387 DEBUG [M:0;jenkins-hbase4:37323] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 20:00:54,387 DEBUG [M:0;jenkins-hbase4:37323] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:54,387 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-19 20:00:54,394 INFO [M:0;jenkins-hbase4:37323] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8ead434046544e1081b7dd183890d1bb 2023-02-19 20:00:54,398 DEBUG [M:0;jenkins-hbase4:37323] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8ead434046544e1081b7dd183890d1bb as hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8ead434046544e1081b7dd183890d1bb 2023-02-19 20:00:54,401 INFO [M:0;jenkins-hbase4:37323] regionserver.HStore(1080): Added hdfs://localhost:39447/user/jenkins/test-data/513ef0cf-c0a5-27a6-75c2-5b4b1f8832b3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8ead434046544e1081b7dd183890d1bb, entries=17, sequenceid=132, filesize=8.6 K 2023-02-19 20:00:54,401 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=132, compaction requested=false 2023-02-19 20:00:54,402 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 20:00:54,402 DEBUG [M:0;jenkins-hbase4:37323] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 20:00:54,404 INFO [M:0;jenkins-hbase4:37323] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 20:00:54,404 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 20:00:54,404 INFO [M:0;jenkins-hbase4:37323] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37323 2023-02-19 20:00:54,405 DEBUG [M:0;jenkins-hbase4:37323] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37323,1676836849402 already deleted, retry=false 2023-02-19 20:00:54,558 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:54,558 INFO [M:0;jenkins-hbase4:37323] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37323,1676836849402; zookeeper connection closed. 2023-02-19 20:00:54,558 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ab3a38b rejected from java.util.concurrent.ThreadPoolExecutor@2e8c3205[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,559 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): master:37323-0x1006e2bb0a90000, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:54,559 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6db7fa45 rejected from java.util.concurrent.ThreadPoolExecutor@2e8c3205[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,658 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:54,658 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35459,1676836849457; zookeeper connection closed. 2023-02-19 20:00:54,658 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6700e17c rejected from java.util.concurrent.ThreadPoolExecutor@593d6b49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,659 DEBUG [Listener at localhost/36541-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1006e2bb0a90001, quorum=127.0.0.1:54993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 20:00:54,659 ERROR [Listener at localhost/36541-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1fbce306 rejected from java.util.concurrent.ThreadPoolExecutor@593d6b49[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 20:00:54,659 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72abfebc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72abfebc 2023-02-19 20:00:54,659 INFO [Listener at localhost/36541] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 20:00:54,659 WARN [Listener at localhost/36541] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:54,663 INFO [Listener at localhost/36541] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:54,764 WARN [BP-1426137322-172.31.14.131-1676836848713 heartbeating to localhost/127.0.0.1:39447] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:54,764 WARN [BP-1426137322-172.31.14.131-1676836848713 heartbeating to localhost/127.0.0.1:39447] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1426137322-172.31.14.131-1676836848713 (Datanode Uuid 86d4f3aa-bb16-49a8-903b-edfc28895e6b) service to localhost/127.0.0.1:39447 2023-02-19 20:00:54,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/dfs/data/data3/current/BP-1426137322-172.31.14.131-1676836848713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:54,765 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/dfs/data/data4/current/BP-1426137322-172.31.14.131-1676836848713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:54,766 WARN [Listener at localhost/36541] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 20:00:54,769 INFO [Listener at localhost/36541] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:54,870 WARN [BP-1426137322-172.31.14.131-1676836848713 heartbeating to localhost/127.0.0.1:39447] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 20:00:54,870 WARN [BP-1426137322-172.31.14.131-1676836848713 heartbeating to localhost/127.0.0.1:39447] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1426137322-172.31.14.131-1676836848713 (Datanode Uuid 7e7bcf54-85c9-4833-b31c-9d9fc5fda79d) service to localhost/127.0.0.1:39447 2023-02-19 20:00:54,871 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/dfs/data/data1/current/BP-1426137322-172.31.14.131-1676836848713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:54,871 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1040fd2-cb4e-8ab2-2c77-073ed995f420/cluster_f43a78f0-6d67-92e3-c682-b4a3da5928bb/dfs/data/data2/current/BP-1426137322-172.31.14.131-1676836848713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 20:00:54,882 INFO [Listener at localhost/36541] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 20:00:54,994 INFO [Listener at localhost/36541] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 20:00:55,014 INFO [Listener at localhost/36541] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 20:00:55,027 INFO [Listener at localhost/36541] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=297 (was 276) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39447 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36541 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37323,1676836849402)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:39447 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39447 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39447 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:39447 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:39447 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39447 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 579) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=440 (was 434) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8841 (was 8876)